Beschreibung

In this role, you will focus on developing and maintaining data pipelines while integrating new Azure features. You will collaborate with teams to ensure data quality and security, while also exploring innovative services to enhance productivity.

Anforderungen

• •2–5 years of experience in data engineering
• •Very good SQL and Python skills
• •Knowledge of CI/CD and DevOps processes
• •Knowledge of cloud security and governance
• •Solution-oriented thinking
• •Strong communication skills
• •Willingness to learn new things
• •Very good German skills
• •Good English skills

Aufgaben

• •Plan and develop robust batch and streaming pipelines
• •Maintain Azure Data Factory, MS Fabric, and Databricks
• •Integrate new Azure features like mirroring and Delta Live Tables
• •Implement Unity Catalog for centralized governance
• •Automate deployments and testing using CI/CD
• •Utilize infrastructure as code with Bicep or Terraform
• •Ensure data quality, lineage, and security
• •Use Microsoft Purview and role-based access control
• •Collaborate with data scientists and product owners
• •Translate requirements into scalable data solutions
• •Evaluate new services like Lakeflow or Microsoft Fabric

Tools & Technologien

Benefits