Your personal AI career agent
Master Thesis Automated Generative AI Evaluation(m/w/x)
Benchmarking Generative AI for in-car LLM/VLM systems, developing evaluation metrics and validation protocols. Hands-on AI evaluation experience required. Mobile work, flexible hours.
Requirements
- Studies in Computer Science, Mathematics, Physics, or related discipline
- Strong programming skills in Python 3
- Ideal experience with machine learning frameworks (TensorFlow or PyTorch)
- Hands-on experience evaluating AI systems
- Strong interest in evaluating AI systems
- Designing evaluation frameworks for AI systems
- Performance measurement of AI systems
- Error analysis of AI systems
- Bias detection in AI systems
- Interest in developing automated applications for in-car systems
- Interest in developing scalable applications for in-car systems
- Motivation for application-oriented research
- Business-fluent English
- German language skills are a plus
Tasks
- Support development of intelligent evaluation systems
- Design test scenarios for in-car LLM and VLM systems
- Develop performance metrics for natural language understanding
- Create validation protocols for multi-agent coordination
- Implement MCP principles in evaluation systems
- Incorporate multimodal context inputs in testing
- Contribute to product and process portfolios
- Collaborate with suppliers and internal teams
- Participate in technical discussions on automotive AI
Education
- Bachelor's degree
Languages
- English – Business Fluent
- German – Basic
Tools & Technologies
- Python 3
- TensorFlow
- PyTorch
Benefits
Mentorship & Coaching
- Comprehensive mentoring & onboarding
Learning & Development
- Personal & professional development
Flexible Working
- Flexible working hours
- Mobile work
Competitive Pay
- Attractive & fair compensation
Other Benefits
- Student apartments
- 6 months duration
Like this job?
BetaYour Career Agent finds similar jobs for you every day.
Not a perfect match?
- BMW GroupFull-timeInternshipWith HomeofficeMünchen
- DENSO
Thesis Student - AI for Automotive Trajectory Prediction(m/w/x)
Full-timeInternshipWith HomeofficeEching - BMW Group
Master Thesis Vision Language Action Models with Memory(m/w/x)
Full-timeInternshipWith HomeofficeMünchen - BMW Group
Master Thesis Student Imitation Learning in Driving Simulation(m/w/x)
Full-timeInternshipWith HomeofficeMünchen - BMW Group
Thesis on AI-Driven Map Matching and Path Prediction on Semantically Enriched Road Networks(m/w/x)
Full-timeInternshipWith HomeofficeUlm, München
Master Thesis Automated Generative AI Evaluation(m/w/x)
Benchmarking Generative AI for in-car LLM/VLM systems, developing evaluation metrics and validation protocols. Hands-on AI evaluation experience required. Mobile work, flexible hours.
Requirements
- Studies in Computer Science, Mathematics, Physics, or related discipline
- Strong programming skills in Python 3
- Ideal experience with machine learning frameworks (TensorFlow or PyTorch)
- Hands-on experience evaluating AI systems
- Strong interest in evaluating AI systems
- Designing evaluation frameworks for AI systems
- Performance measurement of AI systems
- Error analysis of AI systems
- Bias detection in AI systems
- Interest in developing automated applications for in-car systems
- Interest in developing scalable applications for in-car systems
- Motivation for application-oriented research
- Business-fluent English
- German language skills are a plus
Tasks
- Support development of intelligent evaluation systems
- Design test scenarios for in-car LLM and VLM systems
- Develop performance metrics for natural language understanding
- Create validation protocols for multi-agent coordination
- Implement MCP principles in evaluation systems
- Incorporate multimodal context inputs in testing
- Contribute to product and process portfolios
- Collaborate with suppliers and internal teams
- Participate in technical discussions on automotive AI
Education
- Bachelor's degree
Languages
- English – Business Fluent
- German – Basic
Tools & Technologies
- Python 3
- TensorFlow
- PyTorch
Benefits
Mentorship & Coaching
- Comprehensive mentoring & onboarding
Learning & Development
- Personal & professional development
Flexible Working
- Flexible working hours
- Mobile work
Competitive Pay
- Attractive & fair compensation
Other Benefits
- Student apartments
- 6 months duration
Like this job?
BetaYour Career Agent finds similar jobs for you every day.
About the Company
BMW Group
Industry
Automotive
Description
Das Unternehmen bietet spannende Praktika im Bereich Markenerlebnis und Eventmanagement und legt großen Wert auf Gleichbehandlung und Chancengleichheit.
Not a perfect match?
- BMW Group
Master Thesis Vision Language Action Models with Memory(m/w/x)
Full-timeInternshipWith HomeofficeMünchen - DENSO
Thesis Student - AI for Automotive Trajectory Prediction(m/w/x)
Full-timeInternshipWith HomeofficeEching - BMW Group
Master Thesis Vision Language Action Models with Memory(m/w/x)
Full-timeInternshipWith HomeofficeMünchen - BMW Group
Master Thesis Student Imitation Learning in Driving Simulation(m/w/x)
Full-timeInternshipWith HomeofficeMünchen - BMW Group
Thesis on AI-Driven Map Matching and Path Prediction on Semantically Enriched Road Networks(m/w/x)
Full-timeInternshipWith HomeofficeUlm, München