Skip to content
New Job?Nejo!

The AI Job Search Engine

PE
Perplexity
3h ago

Data Scientist, Evals(m/w/x)

Berlin
Full-timeOn-siteExperienced
AI/ML
Data Science

Description

You will drive the accuracy of search-based LLM answers by architecting automated pipelines and visual evaluation tools that directly influence critical product improvements.

Let AI find the perfect jobs for you!

Upload your CV and Nejo AI will find matching job offers for you.

Requirements

  • PhD, MS in technical field, or equivalent experience
  • 4+ years data science or machine learning experience
  • Strong proficiency in Python and SQL
  • Experience with AWS and Databricks cloud stacks
  • Comfort with agentic coding and AI-assisted development
  • 1+ years experience with LLMs at scale
  • Experience with customer-facing web products at scale
  • Strong research background in real-world ML
  • Experience defining evaluation metrics and datasets

Education

Doctoral / PhD
OR
Master's degree

Work Experience

4 years

Tasks

  • Build specialized evaluations to improve answer quality
  • Architect and maintain automated evaluation pipelines
  • Design evaluation sets for tool calls and web search retrieval
  • Develop VLM-based solutions for visual rendering evaluation
  • Review and adapt public benchmarks for product performance
  • Collaborate with technical leadership to shape product changes
  • Measure and improve overall answer quality metrics

Tools & Technologies

PythonSQLAWSDatabricksLLMsLLM-as-a-judge

Languages

EnglishBusiness Fluent

Find the original job posting in its most current version here. Nejo automatically captured this job from the website of Perplexity and processed the information on Nejo with the help of AI for you. Despite careful analysis, some information may be incomplete or inaccurate. Please always verify all details in the original posting! Content and copyrights of the original posting belong to the advertising company.
Not a perfect match?
100+ Similar Jobs in Berlin
  • Perplexity

    Data Scientist/Engineer – Online Metrics(m/w/x)

    Full-timeOn-siteExperienced
    Berlin
  • Perplexity

    Software Engineer - Data Flywheel(m/w/x)

    Full-timeOn-siteExperienced
    Berlin
  • idealo internet GmbH

    Senior Data Scientist – AI Booster Team(m/w/x)

    Full-time/Part-timeOn-siteSenior
    Berlin
  • Prior Labs

    Data Scientist(m/w/x)

    Full-timeOn-siteExperienced
    Freiburg im Breisgau, Berlin
  • Cresta

    Senior Machine Learning Engineer(m/w/x)

    Full-timeOn-siteSenior
    Berlin
100+ View all similar jobs