Skip to content
New Job?Nejo!

The AI Job Search Engine

BLBlack Forest Labs

Member of Technical Staff - Large scale data infrastructure(m/w/x)

Freiburg im Breisgau
Full-timeOn-siteSenior
AI/ML
Data Science

At a generative deep learning firm, building scalable infrastructure for massive image/video datasets, optimizing data retrieval for GPU utilization. Experience building reliable, scalable data loaders and deep cloud object storage knowledge required. High-performance computing environment for AI research.

Requirements

  • Management of large-scale object storage
  • Strong proficiency in Python
  • Experience with various file systems for data manipulation
  • Experience building reliable and scalable data loaders
  • Deep knowledge of cloud object storage
  • Hands-on familiarity with S3 and Azure Blob Storage
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Experience with Slurm/HPC environments
  • Creation and management of PB-scale storage infrastructure
  • Experience with large scale image and video data

Tasks

  • Develop and maintain scalable infrastructure for massive image and video datasets
  • Optimize data retrieval for efficient GPU utilization during training runs
  • Build tools to manage datasets effectively
  • Coordinate data transfers from licensing partners
  • Ensure efficient use of object storage

Work Experience

  • approx. 4 - 6 years

Education

  • Bachelor's degreeOR
  • Master's degree

Languages

  • EnglishBusiness Fluent

Tools & Technologies

  • Python
  • S3
  • Azure Blob Storage
  • AWS
  • GCP
  • Azure
  • Slurm
  • HPC
Find the original job posting in its most current version here. Nejo automatically captured this job from the website of Black Forest Labs and processed the information on Nejo with the help of AI for you. Despite careful analysis, some information may be incomplete or inaccurate. Please always verify all details in the original posting! Content and copyrights of the original posting belong to the advertising company.

  • Black Forest Labs

    Member of Technical Staff - Training Cluster Engineer(m/w/x)

    Full-timeOn-siteExperienced
    Freiburg im Breisgau
  • Prior Labs

    MLOps / ML Systems Engineer(m/w/x)

    Full-timeOn-siteSenior
    Berlin, Freiburg im Breisgau
  • Prior Labs

    ML Engineer, Cloud Platform(m/w/x)

    Full-timeOn-siteExperienced
    Berlin, Freiburg im Breisgau
    from 140,000 / year
  • Prior Labs

    ML Engineer, Foundation Model(m/w/x)

    Full-timeOn-siteExperienced
    Berlin, Freiburg im Breisgau
    from 120,000 / year
  • Black Forest Labs

    Developer Relations Engineer(m/w/x)

    Full-timeOn-siteExperienced
    Freiburg im Breisgau
View all 100+ similar jobs

Nejo is an AI – results may be incomplete or contain mistakes