Skip to content
New Job?Nejo!

Your personal AI career agent

BMBMW Group

Master Thesis Automated Generative AI Evaluation(m/w/x)

München
Full-timeInternshipWith Home Office
AI/ML

Benchmarking Generative AI for in-car LLM/VLM systems, developing evaluation metrics and validation protocols. Hands-on AI evaluation experience required. Mobile work, flexible hours.

Requirements

  • Studies in Computer Science, Mathematics, Physics, or related discipline
  • Strong programming skills in Python 3
  • Ideal experience with machine learning frameworks (TensorFlow or PyTorch)
  • Hands-on experience evaluating AI systems
  • Strong interest in evaluating AI systems
  • Designing evaluation frameworks for AI systems
  • Performance measurement of AI systems
  • Error analysis of AI systems
  • Bias detection in AI systems
  • Interest in developing automated applications for in-car systems
  • Interest in developing scalable applications for in-car systems
  • Motivation for application-oriented research
  • Business-fluent English
  • German language skills are a plus

Tasks

  • Support development of intelligent evaluation systems
  • Design test scenarios for in-car LLM and VLM systems
  • Develop performance metrics for natural language understanding
  • Create validation protocols for multi-agent coordination
  • Implement MCP principles in evaluation systems
  • Incorporate multimodal context inputs in testing
  • Contribute to product and process portfolios
  • Collaborate with suppliers and internal teams
  • Participate in technical discussions on automotive AI

Education

  • Bachelor's degree

Languages

  • EnglishBusiness Fluent
  • GermanBasic

Tools & Technologies

  • Python 3
  • TensorFlow
  • PyTorch

Benefits

Mentorship & Coaching

  • Comprehensive mentoring & onboarding

Learning & Development

  • Personal & professional development

Flexible Working

  • Flexible working hours
  • Mobile work

Competitive Pay

  • Attractive & fair compensation

Other Benefits

  • Student apartments
  • 6 months duration
Find the original job posting in its most current version here. Nejo automatically captured this job from the website of BMW Group and processed the information on Nejo with the help of AI for you. Despite careful analysis, some information may be incomplete or inaccurate. Please always verify all details in the original posting! Content and copyrights of the original posting belong to the advertising company.

Like this job?

Beta

Your Career Agent finds similar jobs for you every day.


  • BMW Group

    Master Thesis Vision Language Action Models with Memory(m/w/x)

    Full-timeInternshipWith Homeoffice
    München
  • DENSO

    Thesis Student - AI for Automotive Trajectory Prediction(m/w/x)

    Full-timeInternshipWith Homeoffice
    Eching
  • BMW Group

    Master Thesis Vision Language Action Models with Memory(m/w/x)

    Full-timeInternshipWith Homeoffice
    München
  • BMW Group

    Master Thesis Student Imitation Learning in Driving Simulation(m/w/x)

    Full-timeInternshipWith Homeoffice
    München
  • BMW Group

    Thesis on AI-Driven Map Matching and Path Prediction on Semantically Enriched Road Networks(m/w/x)

    Full-timeInternshipWith Homeoffice
    Ulm, München
View all 100+ similar jobs

Nejo is an AI – results may be incomplete or contain mistakes