New Job?Nejo!

The AI Job Search Engine

BL
Black Forest Labs
last mo.

Member of Technical Staff - Large scale data infrastructure(m/w/x)

Freiburg im Breisgau
Full-timeOn-siteSenior
AI/ML
Data Science

Description

In this role, you will be at the forefront of building and optimizing data systems that support cutting-edge research and large-scale training runs, working with billions of assets and thousands of GPUs to enhance generative AI capabilities.

Let AI find the perfect jobs for you!

Upload your CV and Nejo AI will find matching job offers for you.

Requirements

  • •Management of large-scale object storage
  • •Strong proficiency in Python
  • •Experience with various file systems for data manipulation
  • •Experience building reliable and scalable data loaders
  • •Deep knowledge of cloud object storage
  • •Hands-on familiarity with S3 and Azure Blob Storage
  • •Experience with cloud platforms (AWS, GCP, or Azure)
  • •Experience with Slurm/HPC environments
  • •Creation and management of PB-scale storage infrastructure
  • •Experience with large scale image and video data

Work Experience

approx. 4 - 6 years

Tasks

  • •Develop and maintain scalable infrastructure for massive image and video datasets
  • •Optimize data retrieval for efficient GPU utilization during training runs
  • •Build tools to manage datasets effectively
  • •Coordinate data transfers from licensing partners
  • •Ensure efficient use of object storage

Tools & Technologies

PythonS3Azure Blob StorageAWSGCPAzureSlurmHPC

Languages

English – Business Fluent

Find the original job posting in its most current version here. Nejo automatically captured this job from the website of Black Forest Labs and processed the information on Nejo with the help of AI for you. Despite careful analysis, some information may be incomplete or inaccurate. Please always verify all details in the original posting! Content and copyrights of the original posting belong to the advertising company.
Not a perfect match?
100+ Similar Jobs in Freiburg im Breisgau
  • Black Forest Labs

    Member of Technical Staff - Data Engineering(m/w/x)

    Full-timeOn-siteExperienced
    Freiburg im Breisgau
  • Black Forest Labs

    Member of Technical Staff - Training Cluster Engineer(m/w/x)

    Full-timeOn-siteExperienced
    Freiburg im Breisgau
  • Black Forest Labs

    Member of Technical Staff - Image / Video Applications(m/w/x)

    Full-timeOn-siteNot specified
    Freiburg im Breisgau
  • Black Forest Labs

    Member of Technical Staff - 3D(m/w/x)

    Full-timeOn-siteNot specified
    Freiburg im Breisgau
  • Prior Labs

    ML Engineer, Cloud Platform(m/w/x)

    Full-timeOn-siteExperienced
    from 140,000 / year
    Berlin, Freiburg im Breisgau
100+ View all similar jobs
Apply now