Beschreibung

In this role, you will design a cutting-edge Databricks Lakehouse while connecting key data sources such as Salesforce. Your expertise will drive the creation of scalable data pipelines and advanced forecasting solutions, while also mentoring the team and ensuring best practices are followed.

Anforderungen

• •5+ years of experience as a Data Engineer
• •3+ years working with Databricks, Spark, and Delta Lake in production
• •Experience in designing and implementing cross-component systems
• •Proficiency in Infrastructure as Code (Terraform)
• •Advanced Python programming
• •CI/CD for building scalable ETL/ELT pipelines and ML infrastructure
• •Expert knowledge in data governance, security, and quality management
• •High initiative and intrinsic motivation for technical development
• •Fluency in English

Aufgaben

• •Design and implement a greenfield Databricks Lakehouse for the CRM domain
• •Connect Salesforce and other key data sources
• •Establish scalable data pipelines and ML infrastructure
• •Transform raw data from Salesforce, Redshift, and Datalake into a high-quality Medallion architecture
• •Apply Infrastructure as Code (Terraform) to provision and configure the Databricks workspace
• •Secure the Databricks workspace and Unity Catalog for GDPR and PII compliance
• •Lead the implementation of data monitoring dashboards and BI solutions
• •Architect bi-directional data flow for CRM activation and advanced customer forecasting
• •Mentor colleagues and review code as the technical expert
• •Define and ensure adherence to engineering best practices for operational excellence

Tools & Technologien

Benefits