Aleph Alpha
Senior AI Researcher - Pre-training Data(m/w/x)
Vollzeitmit HomeofficeSenior
Heidelberg
Neuer Job?Nejo!
Dein persönlicher KI-Karriere-Agent
ALAleph Alpha
Senior AI Software Engineer - Model Evaluation(m/w/x)
Heidelberg
Vollzeitmit HomeofficeSenior
AI/ML
Nejo KI-Zusammenfassung
Designing and implementing evaluation methodologies for foundational AI models in industrial applications. LLM evaluation, benchmark design, and Python skills required. 30 days vacation, hybrid work, and wellness offerings.
Anforderungen
- Experience with LLM evaluation, benchmark design, dataset curation, and experimental design
- Familiarity with statistical methods for evaluation and experiment design
- Track record of shipping impactful technical work (research, infrastructure, or both)
- Strong Python skills and comfort with ML tooling
- Ability to reason about evaluation measures and their relevance
- Ownership mentality: problem diagnosis to solution deployment
- Willingness to relocate to Heidelberg or travel regularly
- Understanding of foundation model training (data, scale, architecture effects)
- Experience with large-scale data processing or ML infrastructure
- German language proficiency (helpful for evaluating German capabilities, not required)
- PhD in machine learning, NLP, statistics, or related field (valued but not required)
Aufgaben
- Design and implement evaluation methodologies
- Select and maintain evaluation datasets
- Develop scoring infrastructure for pre-training
- Optimize evaluation pipelines for speed and reliability
- Build tools for benchmark result interpretation
- Identify and address model capability gaps
- Create or integrate new benchmarks
- Ensure rigorous German language evaluation
- Correlate pre-training metrics with performance outcomes
Berufserfahrung
- ca. 4 - 6 Jahre
Ausbildung
- Doktor / Ph.D.
Sprachen
- Deutsch – Grundkenntnisse
Tools & Technologien
- Python
- PyTorch
- LLM evaluation
- ML tooling
- evaluation frameworks
- distributed systems
- foundation model training
- large-scale data processing
- ML infrastructure
Benefits
Flexibles Arbeiten
- Flexible working hours
- Hybrid working model
Mehr Urlaubstage
- 30 days of paid vacation
Gesundheits- & Fitnessangebote
- Access to fitness & wellness offerings
Mentale Gesundheitsförderung
- Mental health support
Betriebliche Altersvorsorge
- Subsidized company pension plan
Öffi Tickets
- Subsidized Germany-wide transportation ticket
Sonstige Zulagen
- Budget for additional technical equipment
Attraktive Vergütung
- Virtual Stock Option Plan
Firmenfahrrad
- Bike Lease
Die Originalanzeige dieses Stellenangebotes in der aktuellsten Version findest du hier. Nejo hat diesen Job automatisch von der Website des Unternehmens Aleph Alpha erfasst und die Informationen auf Nejo mit Hilfe von KI für dich aufbereitet. Trotz sorgfältiger Analyse können einzelne Informationen unvollständig oder ungenau sein. Bitte prüfe immer alle Angaben in der Originalanzeige! Inhalte und Urheberrechte der Originalanzeige liegen beim ausschreibenden Unternehmen.
Noch nicht perfekt?
- Aleph Alpha
Senior AI Engineer – Pre-training Data(m/w/x)
Vollzeitmit HomeofficeSeniorHeidelberg - Aleph Alpha
Senior Performance Engineer- Pretraining(m/w/x)
Vollzeitmit HomeofficeSeniorHeidelberg - Buhl Data Service GmbH
Senior AI / Data Science Engineer(m/w/x)
Vollzeitmit HomeofficeSeniorMannheim - Aleph Alpha
Senior AI Researcher- Reinforcement learning(m/w/x)
Vollzeitmit HomeofficeSeniorHeidelberg
ALAleph Alpha
Senior AI Software Engineer - Model Evaluation(m/w/x)
Heidelberg
Vollzeitmit HomeofficeSenior
AI/ML
Nejo KI-Zusammenfassung
Designing and implementing evaluation methodologies for foundational AI models in industrial applications. LLM evaluation, benchmark design, and Python skills required. 30 days vacation, hybrid work, and wellness offerings.
Anforderungen
- Experience with LLM evaluation, benchmark design, dataset curation, and experimental design
- Familiarity with statistical methods for evaluation and experiment design
- Track record of shipping impactful technical work (research, infrastructure, or both)
- Strong Python skills and comfort with ML tooling
- Ability to reason about evaluation measures and their relevance
- Ownership mentality: problem diagnosis to solution deployment
- Willingness to relocate to Heidelberg or travel regularly
- Understanding of foundation model training (data, scale, architecture effects)
- Experience with large-scale data processing or ML infrastructure
- German language proficiency (helpful for evaluating German capabilities, not required)
- PhD in machine learning, NLP, statistics, or related field (valued but not required)
Aufgaben
- Design and implement evaluation methodologies
- Select and maintain evaluation datasets
- Develop scoring infrastructure for pre-training
- Optimize evaluation pipelines for speed and reliability
- Build tools for benchmark result interpretation
- Identify and address model capability gaps
- Create or integrate new benchmarks
- Ensure rigorous German language evaluation
- Correlate pre-training metrics with performance outcomes
Berufserfahrung
- ca. 4 - 6 Jahre
Ausbildung
- Doktor / Ph.D.
Sprachen
- Deutsch – Grundkenntnisse
Tools & Technologien
- Python
- PyTorch
- LLM evaluation
- ML tooling
- evaluation frameworks
- distributed systems
- foundation model training
- large-scale data processing
- ML infrastructure
Benefits
Flexibles Arbeiten
- Flexible working hours
- Hybrid working model
Mehr Urlaubstage
- 30 days of paid vacation
Gesundheits- & Fitnessangebote
- Access to fitness & wellness offerings
Mentale Gesundheitsförderung
- Mental health support
Betriebliche Altersvorsorge
- Subsidized company pension plan
Öffi Tickets
- Subsidized Germany-wide transportation ticket
Sonstige Zulagen
- Budget for additional technical equipment
Attraktive Vergütung
- Virtual Stock Option Plan
Firmenfahrrad
- Bike Lease
Die Originalanzeige dieses Stellenangebotes in der aktuellsten Version findest du hier. Nejo hat diesen Job automatisch von der Website des Unternehmens Aleph Alpha erfasst und die Informationen auf Nejo mit Hilfe von KI für dich aufbereitet. Trotz sorgfältiger Analyse können einzelne Informationen unvollständig oder ungenau sein. Bitte prüfe immer alle Angaben in der Originalanzeige! Inhalte und Urheberrechte der Originalanzeige liegen beim ausschreibenden Unternehmen.
Über das Unternehmen
Aleph Alpha
Branche
IT
Beschreibung
The company develops cutting-edge generative AI solutions with a strong emphasis on sovereignty, ethical development, and societal benefit.
Noch nicht perfekt?
- Aleph Alpha
Senior AI Researcher - Pre-training Data(m/w/x)
Vollzeitmit HomeofficeSeniorHeidelberg - Aleph Alpha
Senior AI Engineer – Pre-training Data(m/w/x)
Vollzeitmit HomeofficeSeniorHeidelberg - Aleph Alpha
Senior Performance Engineer- Pretraining(m/w/x)
Vollzeitmit HomeofficeSeniorHeidelberg - Buhl Data Service GmbH
Senior AI / Data Science Engineer(m/w/x)
Vollzeitmit HomeofficeSeniorMannheim - Aleph Alpha
Senior AI Researcher- Reinforcement learning(m/w/x)
Vollzeitmit HomeofficeSeniorHeidelberg