The AI Job Search Engine
Data Scientist, Evals(m/w/x)
Description
You will drive the accuracy of search-based LLM answers by architecting automated pipelines and visual evaluation tools that directly influence critical product improvements.
Let AI find the perfect jobs for you!
Upload your CV and Nejo AI will find matching job offers for you.
Requirements
- •PhD, MS in technical field, or equivalent experience
- •4+ years data science or machine learning experience
- •Strong proficiency in Python and SQL
- •Experience with AWS and Databricks cloud stacks
- •Comfort with agentic coding and AI-assisted development
- •1+ years experience with LLMs at scale
- •Experience with customer-facing web products at scale
- •Strong research background in real-world ML
- •Experience defining evaluation metrics and datasets
Education
Work Experience
4 years
Tasks
- •Build specialized evaluations to improve answer quality
- •Architect and maintain automated evaluation pipelines
- •Design evaluation sets for tool calls and web search retrieval
- •Develop VLM-based solutions for visual rendering evaluation
- •Review and adapt public benchmarks for product performance
- •Collaborate with technical leadership to shape product changes
- •Measure and improve overall answer quality metrics
Tools & Technologies
Languages
English – Business Fluent
- PerplexityFull-timeOn-siteExperiencedBerlin
- Perplexity
Software Engineer - Data Flywheel(m/w/x)
Full-timeOn-siteExperiencedBerlin - idealo internet GmbH
Senior Data Scientist – AI Booster Team(m/w/x)
Full-time/Part-timeOn-siteSeniorBerlin - Prior Labs
Data Scientist(m/w/x)
Full-timeOn-siteExperiencedFreiburg im Breisgau, Berlin - Cresta
Senior Machine Learning Engineer(m/w/x)
Full-timeOn-siteSeniorBerlin
Data Scientist, Evals(m/w/x)
The AI Job Search Engine
Description
You will drive the accuracy of search-based LLM answers by architecting automated pipelines and visual evaluation tools that directly influence critical product improvements.
Let AI find the perfect jobs for you!
Upload your CV and Nejo AI will find matching job offers for you.
Requirements
- •PhD, MS in technical field, or equivalent experience
- •4+ years data science or machine learning experience
- •Strong proficiency in Python and SQL
- •Experience with AWS and Databricks cloud stacks
- •Comfort with agentic coding and AI-assisted development
- •1+ years experience with LLMs at scale
- •Experience with customer-facing web products at scale
- •Strong research background in real-world ML
- •Experience defining evaluation metrics and datasets
Education
Work Experience
4 years
Tasks
- •Build specialized evaluations to improve answer quality
- •Architect and maintain automated evaluation pipelines
- •Design evaluation sets for tool calls and web search retrieval
- •Develop VLM-based solutions for visual rendering evaluation
- •Review and adapt public benchmarks for product performance
- •Collaborate with technical leadership to shape product changes
- •Measure and improve overall answer quality metrics
Tools & Technologies
Languages
English – Business Fluent
About the Company
Perplexity
Industry
IT
Description
The company focuses on building advanced search technologies, emphasizing retrieval and ranking.
- Perplexity
Data Scientist/Engineer – Online Metrics(m/w/x)
Full-timeOn-siteExperiencedBerlin - Perplexity
Software Engineer - Data Flywheel(m/w/x)
Full-timeOn-siteExperiencedBerlin - idealo internet GmbH
Senior Data Scientist – AI Booster Team(m/w/x)
Full-time/Part-timeOn-siteSeniorBerlin - Prior Labs
Data Scientist(m/w/x)
Full-timeOn-siteExperiencedFreiburg im Breisgau, Berlin - Cresta
Senior Machine Learning Engineer(m/w/x)
Full-timeOn-siteSeniorBerlin