Skip to content
New Job?Nejo!

Your personal AI career agent

SCScout24

Senior MLOps / LLMOps Engineer(m/w/x)

Berlin
Full-timeWith Home OfficeSenior
AI/ML

Building scalable ML and LLM systems, operating self-hosted models and evaluation frameworks for Germany's #1 real estate platform. Strong MLOps, Python, and production system operation skills required. Hybrid work, 30 days vacation, and work-from-abroad option.

Requirements

  • Strong MLOps experience (CI/CD, Docker, Kubernetes)
  • Experience operating production-grade systems
  • Proficiency in Python
  • Solid software engineering skills
  • Scalable system design skills
  • Hands-on LLMs experience
  • Generative AI technologies experience (e.g. GPT, Gemini or Anthropic-like models)
  • Expertise in prompt engineering
  • Expertise in agent orchestration
  • Expertise in context management
  • Expertise in output validation
  • Experience with LLM evaluation frameworks
  • Experience deploying self-hosted LLMs
  • Familiarity with cloud platforms (e.g. AWS, GCP)
  • Familiarity with DevOps practices
  • Familiarity with testing practices
  • Familiarity with observability practices
  • Strong communication skills
  • Ability to collaborate with cross-functional teams
  • Ability to collaborate with stakeholders
  • Support for professional development of people with disabilities

Tasks

  • Build scalable ML and LLM-based systems
  • Operate self-hosted models and evaluation frameworks
  • Ensure platform reliability and robustness
  • Shape AI platform for efficient development and deployment
  • Enable teams to scale traditional ML and generative AI solutions
  • Ensure ML/LLM applications are observable and cost-efficient
  • Establish best practices for LLMOps
  • Design and maintain scalable ML/LLM infrastructure
  • Productionize ML and generative AI solutions
  • Own ML/LLMOps lifecycle: prompting, deployment, monitoring, evaluation, optimization
  • Build and evolve LLM Gateway service
  • Standardize access, routing, and governance for LLMs
  • Develop evaluation frameworks for quality, performance, reliability
  • Design MCP-compatible services for context exchange
  • Integrate MCP into internal platforms
  • Support tool use, retrieval, and agent-based workflows
  • Work with AWS and self-hosted open-source AI models
  • Ensure system observability and cost efficiency
  • Contribute to project management and stakeholder communication
  • Collaborate across teams

Work Experience

  • approx. 4 - 6 years

Education

  • Bachelor's degreeOR
  • Master's degree

Languages

  • EnglishBusiness Fluent

Tools & Technologies

  • MLOps
  • CI/CD
  • Docker
  • Kubernetes
  • Python
  • LLMs
  • GPT
  • Gemini
  • Anthropic
  • AWS
  • GCP

Benefits

Flexible Working

  • Hybrid work model

More Vacation Days

  • 30 days of vacation

Workation & Sabbatical

  • Work from abroad (10 days/year)

Other Benefits

  • Visa process support
  • Structured feedback
  • Diversity initiatives
  • Support for people with disabilities
  • Disability representative

Additional Allowances

  • Relocation package

Corporate Discounts

  • Employee discount on products

Learning & Development

  • Dedicated learning time
  • Online courses
  • Lunch & Learn events

Diverse Work

  • Book challenges

Career Advancement

  • Individual career paths

Family Support

  • Family service support

Informal Culture

  • Dog-friendly office

Public Transport Subsidies

  • Public transport subsidy

Company Bike

  • Job Bikes

Sustainability Focus

  • Environmental and climate protection goals
  • 100% green electricity

Team Events

  • Social activities

Social Impact

  • Charitable organization involvement

Retirement Plans

  • Company pension scheme

Healthcare & Fitness

  • Gym with courses
  • Health check-ups

Modern Office

  • Napping room

Startup Environment

  • Rooftop terrace

Snacks & Drinks

  • Organic coffee

Free or Subsidized Food

  • Cafeteria

Mental Health Support

  • Massage therapist
  • Life Situation Coaching

Modern Equipment

  • Latest technical tools and hardware
Find the original job posting in its most current version here. Nejo automatically captured this job from the website of Scout24 and processed the information on Nejo with the help of AI for you. Despite careful analysis, some information may be incomplete or inaccurate. Please always verify all details in the original posting! Content and copyrights of the original posting belong to the advertising company.

Like this job?

Beta

Your Career Agent finds similar jobs for you every day.


  • Scout24

    Senior MLOps / LLMOps Engineer(m/w/x)

    Full-timeWith HomeofficeSenior
    Berlin
  • AUTO1 Group

    Senior Machine Learning Platform/Ops Engineer(m/w/x)

    Full-timeWith HomeofficeSenior
    Berlin
  • Nomitri

    Senior DevOps/MLOps(m/w/x)

    Full-timeWith HomeofficeSenior
    Berlin
  • AUTO1 Group

    (Senior) Machine Learning Platform/Ops Engineer(m/w/x)

    Full-timeWith HomeofficeExperienced
    Berlin
  • ZDF Sparks GmbH

    Senior AI Engineer(m/w/x)

    Full-timeWith HomeofficeSenior
    Berlin
View all 100+ similar jobs

Nejo is an AI – results may be incomplete or contain mistakes