Your personal AI career agent
Member of Technical Staff - Pretraining(m/w/x)
Leading large-scale pretraining experiments and shaping multimodal foundation models for image/video creation. Deep experience with distributed training and architectural design required. Travel costs covered, with potential for top-venue publications.
Requirements
- Led or co-owned pretraining for foundation model
- Own architectural calls: attention patterns, modulation schemes, loss formulations, tokenization strategies
- Deep experience with large-scale distributed training
- Strong intuition for architecture and objective design
- Track record of shipping: top-venue publications or production impact
- Deep Python and PyTorch proficiency
- Familiarity with visual generative models
Tasks
- Lead large-scale pretraining experiments
- Shape multimodal foundation models
- Develop novel architecture ideas
- Evaluate new optimizers and training algorithms
- Optimize low-level GPU and systems performance
- Contribute to research code and model design
- Drive independent research projects
- Lead cross-team initiatives
Work Experience
- approx. 4 - 6 years
Education
- Bachelor's degreeOR
- Master's degree
Languages
- English – Business Fluent
Tools & Technologies
- FSDP
- TP
- PP
- Python
- PyTorch
Benefits
Additional Allowances
- Reasonable travel costs covered
Like this job?
BetaYour Career Agent finds similar jobs for you every day.
Not a perfect match?
- Black Forest LabsFull-timeWith HomeofficeSeniorFreiburg im Breisgau
- Black Forest Labs
Member of Technical Staff - Image / Video Researcher(m/w/x)
Full-timeWith HomeofficeExperiencedFreiburg im Breisgau - Endress+Hauser InfoServe GmbH+Co. KG
Internship/Thesis- Improve Denoising Diffusion Models for Multimodal Anomaly Detection(m/w/x)
Full-timeInternshipWith HomeofficeFreiburg im Breisgau, Weil am Rhein - Jedox GmbH
Head of Platform AI Innovation(m/w/x)
Full-timeWith HomeofficeSeniorFreiburg im Breisgau - Haufe Group
AI Automation Engineer(m/w/x)
Full-timeWith HomeofficeExperiencedFreiburg im Breisgau
Member of Technical Staff - Pretraining(m/w/x)
Leading large-scale pretraining experiments and shaping multimodal foundation models for image/video creation. Deep experience with distributed training and architectural design required. Travel costs covered, with potential for top-venue publications.
Requirements
- Led or co-owned pretraining for foundation model
- Own architectural calls: attention patterns, modulation schemes, loss formulations, tokenization strategies
- Deep experience with large-scale distributed training
- Strong intuition for architecture and objective design
- Track record of shipping: top-venue publications or production impact
- Deep Python and PyTorch proficiency
- Familiarity with visual generative models
Tasks
- Lead large-scale pretraining experiments
- Shape multimodal foundation models
- Develop novel architecture ideas
- Evaluate new optimizers and training algorithms
- Optimize low-level GPU and systems performance
- Contribute to research code and model design
- Drive independent research projects
- Lead cross-team initiatives
Work Experience
- approx. 4 - 6 years
Education
- Bachelor's degreeOR
- Master's degree
Languages
- English – Business Fluent
Tools & Technologies
- FSDP
- TP
- PP
- Python
- PyTorch
Benefits
Additional Allowances
- Reasonable travel costs covered
Like this job?
BetaYour Career Agent finds similar jobs for you every day.
About the Company
Black Forest Labs
Industry
IT
Description
The company advances generative deep learning for media, creating models that transform ideas into images and videos.
Not a perfect match?
- Black Forest Labs
Member of Technical Staff - VLM(m/w/x)
Full-timeWith HomeofficeSeniorFreiburg im Breisgau - Black Forest Labs
Member of Technical Staff - Image / Video Researcher(m/w/x)
Full-timeWith HomeofficeExperiencedFreiburg im Breisgau - Endress+Hauser InfoServe GmbH+Co. KG
Internship/Thesis- Improve Denoising Diffusion Models for Multimodal Anomaly Detection(m/w/x)
Full-timeInternshipWith HomeofficeFreiburg im Breisgau, Weil am Rhein - Jedox GmbH
Head of Platform AI Innovation(m/w/x)
Full-timeWith HomeofficeSeniorFreiburg im Breisgau - Haufe Group
AI Automation Engineer(m/w/x)
Full-timeWith HomeofficeExperiencedFreiburg im Breisgau