Skip to content
New Job?Nejo!

Your personal AI career agent

HOHostaway

Staff Backend Engineer, AI Platform(m/w/x)

Wien, Berlin
Full-timeRemoteSenior
AI/ML

Designing multi-agent systems and LLM gateways for AI platform architecture. 8+ years software engineering experience, including 2+ years at Staff level, required. 100% remote work with company-wide knowledge sharing sessions.

Requirements

  • 8+ years software engineering experience
  • At least 2 years at Staff level
  • Deep Python expertise
  • Proficient in production-grade Python services
  • Production experience with LLM-based systems
  • Experience operating AI features at scale
  • Understanding of AI operational realities
  • Strong architectural instincts
  • Ability to design evolving systems
  • Pragmatic trade-offs between speed and extensibility
  • Familiarity with modern AI tooling ecosystem
  • Experience with AI frameworks and libraries
  • Confidence evaluating and integrating AI tools
  • Multi-agent architecture experience
  • Experience with agent orchestration
  • Comfort working across polyglot stack
  • Adaptability to read and integrate code
  • Infrastructure fluency
  • Comfort with AWS
  • Comfort with Kubernetes
  • Comfort with CI/CD pipelines
  • Comfort operating services in production
  • Cross-team influence
  • Ability to lead through clarity and credibility
  • Experience driving adoption beyond immediate team

Tasks

  • Own AI Platform architecture and technical direction
  • Lead design of multi-agent system
  • Implement agent orchestrator
  • Build LLM gateway
  • Develop prompt and tool versioning
  • Create evaluation framework
  • Establish end-to-end observability
  • Build production-grade AI infrastructure
  • Design core AI services
  • Implement reliable AI features
  • Ensure AI features are versioned
  • Make AI features observable
  • Ensure AI features are safe to ship
  • Drive AI evaluation and quality
  • Establish quality gates for AI features
  • Implement prompt comparison workflows
  • Develop hallucination detection
  • Integrate CI/CD for AI features
  • Shape LLM gateway strategy
  • Ensure LLM provider failover
  • Implement LLM model routing
  • Manage LLM cost tracking
  • Implement LLM rate limiting
  • Champion cross-team AI Platform adoption
  • Collaborate with product teams
  • Publish internal AI Platform blueprints
  • Define AI integration patterns
  • Enable teams to build specialized agents
  • Influence engineering-wide AI practices
  • Drive best practices for prompt engineering
  • Drive best practices for tool design
  • Drive best practices for AI observability
  • Drive best practices for agent testing
  • Mentor and elevate AI engineers
  • Raise technical bar across AI team
  • Provide code review
  • Offer architectural guidance
  • Conduct hands-on pairing

Work Experience

  • 8 years

Education

  • Bachelor's degreeOR
  • Master's degree

Languages

  • EnglishBusiness Fluent

Tools & Technologies

  • Python
  • PydanticAI
  • LangChain
  • LangGraph
  • LiteLLM
  • Langfuse
  • Phoenix
  • MLflow
  • Go
  • PHP
  • React
  • AWS
  • Kubernetes
  • CI/CD

Benefits

Flexible Working

  • 100% Remote
Find the original job posting in its most current version here. Nejo automatically captured this job from the website of Hostaway and processed the information on Nejo with the help of AI for you. Despite careful analysis, some information may be incomplete or inaccurate. Please always verify all details in the original posting! Content and copyrights of the original posting belong to the advertising company.

  • 9amHealth

    Senior Full Stack Engineer, AI Platform(m/w/x)

    Full-timeWith HomeofficeSenior
    Wien
    from 85,000 / year
  • The Flex

    Lead Full-Stack Engineer(m/w/x)

    Full-timeRemoteSenior
    Wien
  • Flinn.ai

    Senior Fullstack Engineer(m/w/x)

    Full-timeWith HomeofficeSenior
    Wien, Berlin
  • fiskaly

    Agentic Backend Engineer (Golang)(m/w/x)

    Full-timeWith HomeofficeSenior
    Berlin, Wien
  • Adverity

    Staff Full Stack Engineer(m/w/x)

    Full-timeWith HomeofficeSenior
    Wien
    from 80,000 / year
View all 100+ similar jobs

Nejo is an AI – results may be incomplete or contain mistakes