Skip to content
New Job?Nejo!

Your personal AI career agent

IGiGroove AG

Senior Data Pipeline Engineer(m/w/x)

Zürich
Full-timeWith Home OfficeSenior
AI/ML

Building and scaling AI-driven music label operations platform's data backbone. 5+ years Python web crawling and pipeline orchestration experience required. Remote-friendly with flexible hours.

Requirements

  • 5+ years building data pipelines/web crawling infrastructure
  • Strong Python skills (Scrapy, BeautifulSoup, Selenium, Playwright, or equivalent)
  • Experience with pipeline orchestration tools (Airflow, Prefect, or Dagster)
  • Solid understanding of databases (PostgreSQL, MongoDB, or similar) and data modeling
  • Experience handling messy, inconsistent data and building validation layers
  • Comfort with cloud infrastructure (AWS, GCP, or Azure)
  • Track record of building reliable, self-supervised systems
  • Deep familiarity with AI tools and workflows
  • Experience with headless browsers and anti-detection techniques at scale
  • Familiarity with music industry, streaming platforms, or media data
  • Experience with data warehousing (BigQuery, Snowflake, Redshift)
  • Exposure to message queues (Kafka, RabbitMQ, Redis)
  • Experience building internal tooling and dashboards
  • Systems thinking for crawling/data ingestion infrastructure
  • Experience with sites changing layouts, anti-bot systems, rate limits, inconsistent APIs, missing data
  • End-to-end pipeline ownership
  • Self-directed with architectural decision-making
  • Obsessive focus on data quality and validation checks

Tasks

  • Build and own data ingestion infrastructure
  • Own the company's data backbone
  • Scale existing data infrastructure
  • Improve data infrastructure reliability
  • Expand data coverage
  • Add new data sources
  • Evolve data architecture
  • Design new data pipelines
  • Build new data pipelines
  • Shape external data collection
  • Shape external data processing
  • Inherit and own existing data infrastructure

Work Experience

  • 5 - 7 years

Education

  • Bachelor's degreeOR
  • Master's degree

Languages

  • EnglishBusiness Fluent

Tools & Technologies

  • Python
  • Scrapy
  • BeautifulSoup
  • Selenium
  • Playwright
  • Airflow
  • Prefect
  • Dagster
  • PostgreSQL
  • MongoDB
  • AWS
  • GCP
  • Azure
  • BigQuery
  • Snowflake
  • Redshift
  • Kafka
  • RabbitMQ
  • Redis

Benefits

Flexible Working

  • Remote-friendly
  • Flexible hours
Find the original job posting in its most current version here. Nejo automatically captured this job from the website of iGroove AG and processed the information on Nejo with the help of AI for you. Despite careful analysis, some information may be incomplete or inaccurate. Please always verify all details in the original posting! Content and copyrights of the original posting belong to the advertising company.

  • Speechify

    Software Engineer, Data Infrastructure & Acquisition(m/w/x)

    Full-timeRemoteSenior
    Zürich
  • RepRisk AG

    Senior Data Engineer(m/w/x)

    Full-timeWith HomeofficeSenior
    Zürich
  • Zühlke Engineering AG

    Senior Data Engineer(m/w/x)

    Full-timeWith HomeofficeSenior
    Schlieren
  • Consulteer

    Data Engineering Team Lead - ML & Robotics Data(m/w/x)

    Full-timeWith HomeofficeSenior
    Zürich
    from USD 80,000 - 100,000 / year
  • Mimacom AG

    Data Engineer(m/w/x)

    Full-timeWith HomeofficeSenior
    Zürich
View all 100+ similar jobs

Nejo is an AI – results may be incomplete or contain mistakes