Skip to content
New Job?Nejo!

Your personal AI career agent

CACanva

Machine Learning Engineering Manager - Evaluations(m/w/x)

Wien
Full-timeRemoteSenior
AI/ML

Building AI-powered design tools for visual models. Expert knowledge deploying and scaling generative models required. Equity packages, flexible leave options.

Requirements

  • Leadership of machine learning engineering teams
  • Coaching and delivering production systems
  • Expert knowledge deploying generative models
  • Scaling generative models in production
  • Focus on visual models (image, video, design)
  • Hands-on ML infrastructure building
  • Building ML evaluation pipelines
  • Building ML monitoring systems at scale
  • Creating data-driven evaluation methodologies
  • Turning analytics into actionable insights
  • Strong systems design skills
  • Experience with MLOps
  • Experience with model serving
  • Experience with production reliability
  • Experience with visual quality assessment
  • Experience with aesthetic modelling
  • Experience with human preference learning
  • Tackling automated metrics vs human raters gap
  • Understanding of design principles
  • Operationalising design principles as signals
  • Thriving in collaborative environments
  • Clear communication with technical audiences
  • Clear communication with non-technical audiences
  • Staying current with SOTA research trends
  • Staying current with engineering best practices
  • Energised by continuous learning
  • Provide pronouns when applying
  • Disclose reasonable adjustments for interview

Tasks

  • Lead and grow a high-performing team of Machine Learning Engineers and Research Scientists
  • Set strategic technical direction for the team
  • Coach and mentor team members to deliver impactful engineering solutions
  • Design, build, and maintain robust evaluation systems
  • Develop quality metrics and safety monitoring processes
  • Conduct red-teaming and competitive benchmarking
  • Create automated metrics for human aesthetic judgment
  • Advise on human evaluation pipelines
  • Close the loop between user signals and model improvements
  • Align technical strategy with Canva's AI and product goals
  • Guide engineering direction for model deployment and production systems
  • Partner cross-functionally to ensure reliable product impact

Work Experience

  • approx. 4 - 6 years

Education

  • Bachelor's degreeOR
  • Master's degree

Languages

  • EnglishBusiness Fluent

Tools & Technologies

  • Diffusion models
  • GANs
  • VAEs
  • LLMs
  • ML infrastructure
  • MLOps

Benefits

Competitive Pay

  • Equity packages

Generous Parental Leave

  • Inclusive parental leave

Additional Allowances

  • Annual Vibe & Thrive allowance

Workation & Sabbatical

  • Flexible leave options
Find the original job posting in its most current version here. Nejo automatically captured this job from the website of Canva and processed the information on Nejo with the help of AI for you. Despite careful analysis, some information may be incomplete or inaccurate. Please always verify all details in the original posting! Content and copyrights of the original posting belong to the advertising company.

Like this job?

Beta

Your Career Agent finds similar jobs for you every day.


  • Canva

    Senior Machine Learning Engineer - Multimodal Data(m/w/x)

    Full-timeWith HomeofficeSenior
    Wien
  • Becton, Dickinson and Company

    Senior Machine Learning Engineer(m/w/x)

    Full-time/Part-timeWith HomeofficeSenior
    Wien
    from 52,136 / year
  • JobCloud AG

    Senior Engineering Manager(m/w/x)

    Full-timeWith HomeofficeSenior
    Wien
    from 75,000 - 90,000 / year
  • TÜV AUSTRIA Holding AG

    Machine Learning Engineer(m/w/x)

    Full-timeWith HomeofficeSenior
    Wien
    from 60,000 / year
  • Avomind

    Senior AI Product Engineer / AI Workflow Architect(m/w/x)

    Full-timeWith HomeofficeSenior
    Wien
View all 100+ similar jobs

Nejo is an AI – results may be incomplete or contain mistakes