Research Engineer / Research Scientist, Pretraining(m/w/x)

Description

You will advance multimodal LLMs in Zurich by blending cutting-edge research with practical engineering to build the next generation of safe, scalable, and highly efficient AI systems.

Requirements

• •Degree in Computer Science or related field
• •Strong software engineering skills
• •Expertise in Python and deep learning
• •Experience with large-scale ML systems
• •Familiarity with ML Accelerators and Kubernetes
• •Problem-solving skills and results-oriented mindset
• •Excellent communication and collaboration skills
• •Significant software engineering experience
• •Ability to balance research and engineering
• •Willingness to support team tasks
• •Enjoyment of pair programming
• •Eagerness to learn machine learning research
• •Enthusiasm for large-scale AI research
• •Ambition for AI safety and progress

Tasks

• •Research and implement model architectures
• •Develop algorithms and optimizers
• •Process and prepare large-scale datasets
• •Lead independent research projects
• •Collaborate on large-scale team initiatives
• •Design and analyze scientific experiments
• •Optimize and scale training infrastructure
• •Improve developer tooling and productivity
• •Optimize throughput for novel attention mechanisms
• •Propose and experimentally compare Transformer variants
• •Scale distributed training to thousands of accelerators
• •Design fault tolerance for training infrastructure
• •Create interactive visualizations of model internals

Tools & Technologies

Benefits