Skip to content
New Job?Nejo!

The AI Job Search Engine

PEPerplexity

Data Scientist, Evals(m/w/x)

Berlin
Full-timeOn-siteExperienced
AI/ML
Data Science

Architecting automated evaluation pipelines for search technologies, including VLM-based visual rendering and public benchmark adaptation. 4+ years data science/ML experience with AWS/Databricks proficiency required. Focus on cutting-edge AI/ML in advanced search technologies.

Requirements

  • PhD, MS in technical field, or equivalent experience
  • 4+ years data science or machine learning experience
  • Strong proficiency in Python and SQL
  • Experience with AWS and Databricks cloud stacks
  • Comfort with agentic coding and AI-assisted development
  • 1+ years experience with LLMs at scale
  • Experience with customer-facing web products at scale
  • Strong research background in real-world ML
  • Experience defining evaluation metrics and datasets

Tasks

  • Build specialized evaluations to improve answer quality
  • Architect and maintain automated evaluation pipelines
  • Design evaluation sets for tool calls and web search retrieval
  • Develop VLM-based solutions for visual rendering evaluation
  • Review and adapt public benchmarks for product performance
  • Collaborate with technical leadership to shape product changes
  • Measure and improve overall answer quality metrics

Work Experience

  • 4 years

Education

  • Master's degree

Languages

  • EnglishBusiness Fluent

Tools & Technologies

  • Python
  • SQL
  • AWS
  • Databricks
  • LLMs
  • LLM-as-a-judge
Find the original job posting in its most current version here. Nejo automatically captured this job from the website of Perplexity and processed the information on Nejo with the help of AI for you. Despite careful analysis, some information may be incomplete or inaccurate. Please always verify all details in the original posting! Content and copyrights of the original posting belong to the advertising company.

  • Perplexity

    Data Scientist/Engineer – Online Metrics(m/w/x)

    Full-timeOn-siteExperienced
    Berlin
  • SumUp

    Data Scientist(m/w/x)

    Full-timeOn-siteExperienced
    Berlin
  • Perplexity

    Software Engineer - Data Flywheel(m/w/x)

    Full-timeOn-siteExperienced
    Berlin
  • Prior Labs

    Data Scientist(m/w/x)

    Full-timeOn-siteExperienced
    Freiburg im Breisgau, Berlin
  • Cresta

    Senior Machine Learning Engineer(m/w/x)

    Full-timeOn-siteSenior
    Berlin
View all 100+ similar jobs

Nejo is an AI – results may be incomplete or contain mistakes