Your personal AI career agent
Machine Learning Engineering Manager - Evaluations(m/w/x)
Building AI-powered design tools for visual models. Expert knowledge deploying and scaling generative models required. Equity packages, flexible leave options.
Requirements
- Leadership of machine learning engineering teams
- Coaching and delivering production systems
- Expert knowledge deploying generative models
- Scaling generative models in production
- Focus on visual models (image, video, design)
- Hands-on ML infrastructure building
- Building ML evaluation pipelines
- Building ML monitoring systems at scale
- Creating data-driven evaluation methodologies
- Turning analytics into actionable insights
- Strong systems design skills
- Experience with MLOps
- Experience with model serving
- Experience with production reliability
- Experience with visual quality assessment
- Experience with aesthetic modelling
- Experience with human preference learning
- Tackling automated metrics vs human raters gap
- Understanding of design principles
- Operationalising design principles as signals
- Thriving in collaborative environments
- Clear communication with technical audiences
- Clear communication with non-technical audiences
- Staying current with SOTA research trends
- Staying current with engineering best practices
- Energised by continuous learning
- Provide pronouns when applying
- Disclose reasonable adjustments for interview
Tasks
- Lead and grow a high-performing team of Machine Learning Engineers and Research Scientists
- Set strategic technical direction for the team
- Coach and mentor team members to deliver impactful engineering solutions
- Design, build, and maintain robust evaluation systems
- Develop quality metrics and safety monitoring processes
- Conduct red-teaming and competitive benchmarking
- Create automated metrics for human aesthetic judgment
- Advise on human evaluation pipelines
- Close the loop between user signals and model improvements
- Align technical strategy with Canva's AI and product goals
- Guide engineering direction for model deployment and production systems
- Partner cross-functionally to ensure reliable product impact
Work Experience
- approx. 4 - 6 years
Education
- Bachelor's degreeOR
- Master's degree
Languages
- English – Business Fluent
Tools & Technologies
- Diffusion models
- GANs
- VAEs
- LLMs
- ML infrastructure
- MLOps
Benefits
Competitive Pay
- Equity packages
Generous Parental Leave
- Inclusive parental leave
Additional Allowances
- Annual Vibe & Thrive allowance
Workation & Sabbatical
- Flexible leave options
Like this job?
BetaYour Career Agent finds similar jobs for you every day.
Not a perfect match?
- CanvaFull-timeWith HomeofficeSeniorWien
- Becton, Dickinson and Company
Senior Machine Learning Engineer(m/w/x)
Full-time/Part-timeWith HomeofficeSeniorWienfrom 52,136 / year - JobCloud AG
Senior Engineering Manager(m/w/x)
Full-timeWith HomeofficeSeniorWienfrom 75,000 - 90,000 / year - TÜV AUSTRIA Holding AG
Machine Learning Engineer(m/w/x)
Full-timeWith HomeofficeSeniorWienfrom 60,000 / year - Avomind
Senior AI Product Engineer / AI Workflow Architect(m/w/x)
Full-timeWith HomeofficeSeniorWien
Machine Learning Engineering Manager - Evaluations(m/w/x)
Building AI-powered design tools for visual models. Expert knowledge deploying and scaling generative models required. Equity packages, flexible leave options.
Requirements
- Leadership of machine learning engineering teams
- Coaching and delivering production systems
- Expert knowledge deploying generative models
- Scaling generative models in production
- Focus on visual models (image, video, design)
- Hands-on ML infrastructure building
- Building ML evaluation pipelines
- Building ML monitoring systems at scale
- Creating data-driven evaluation methodologies
- Turning analytics into actionable insights
- Strong systems design skills
- Experience with MLOps
- Experience with model serving
- Experience with production reliability
- Experience with visual quality assessment
- Experience with aesthetic modelling
- Experience with human preference learning
- Tackling automated metrics vs human raters gap
- Understanding of design principles
- Operationalising design principles as signals
- Thriving in collaborative environments
- Clear communication with technical audiences
- Clear communication with non-technical audiences
- Staying current with SOTA research trends
- Staying current with engineering best practices
- Energised by continuous learning
- Provide pronouns when applying
- Disclose reasonable adjustments for interview
Tasks
- Lead and grow a high-performing team of Machine Learning Engineers and Research Scientists
- Set strategic technical direction for the team
- Coach and mentor team members to deliver impactful engineering solutions
- Design, build, and maintain robust evaluation systems
- Develop quality metrics and safety monitoring processes
- Conduct red-teaming and competitive benchmarking
- Create automated metrics for human aesthetic judgment
- Advise on human evaluation pipelines
- Close the loop between user signals and model improvements
- Align technical strategy with Canva's AI and product goals
- Guide engineering direction for model deployment and production systems
- Partner cross-functionally to ensure reliable product impact
Work Experience
- approx. 4 - 6 years
Education
- Bachelor's degreeOR
- Master's degree
Languages
- English – Business Fluent
Tools & Technologies
- Diffusion models
- GANs
- VAEs
- LLMs
- ML infrastructure
- MLOps
Benefits
Competitive Pay
- Equity packages
Generous Parental Leave
- Inclusive parental leave
Additional Allowances
- Annual Vibe & Thrive allowance
Workation & Sabbatical
- Flexible leave options
Like this job?
BetaYour Career Agent finds similar jobs for you every day.
About the Company
Canva
Industry
IT
Description
The company is a fast-growing platform that redefines how the world experiences design.
Not a perfect match?
- Canva
Senior Machine Learning Engineer - Multimodal Data(m/w/x)
Full-timeWith HomeofficeSeniorWien - Becton, Dickinson and Company
Senior Machine Learning Engineer(m/w/x)
Full-time/Part-timeWith HomeofficeSeniorWienfrom 52,136 / year - JobCloud AG
Senior Engineering Manager(m/w/x)
Full-timeWith HomeofficeSeniorWienfrom 75,000 - 90,000 / year - TÜV AUSTRIA Holding AG
Machine Learning Engineer(m/w/x)
Full-timeWith HomeofficeSeniorWienfrom 60,000 / year - Avomind
Senior AI Product Engineer / AI Workflow Architect(m/w/x)
Full-timeWith HomeofficeSeniorWien