Beschreibung

In this role, you will focus on building and maintaining data pipelines while integrating the latest Azure features. Collaborating with data scientists and product owners will help translate complex requirements into effective data solutions.

Anforderungen

• •2–5 years of experience in data engineering
• •Very good SQL and Python skills
• •Knowledge of CI/CD and DevOps processes
• •Knowledge of cloud security and governance
• •Solution-oriented thinking
• •Strong communication skills
• •Willingness to learn new things
• •Very good German skills
• •Good English skills

Aufgaben

• •Plan and develop robust batch and streaming pipelines
• •Maintain Azure Data Factory, MS Fabric, and Databricks
• •Integrate new Azure features like mirroring and Delta Live Tables
• •Implement Unity Catalog for centralized governance
• •Automate deployments and testing using CI/CD
• •Utilize infrastructure as code with Bicep or Terraform
• •Ensure data quality, lineage, and security
• •Use Microsoft Purview and role-based access control
• •Collaborate with data scientists and product owners
• •Translate requirements into scalable data solutions
• •Evaluate new services like Lakeflow or Microsoft Fabric

Tools & Technologien

Benefits