Original Beschreibung
## Job Description
We are looking for a Senior Data Engineer to lead our data pipelines' design, development, and optimization. You will be responsible for architecting and maintaining robust ingestion processes, ensuring data consistency, and collaborating closely with the product and analytics teams. In this role, you’ll tackle everything from new data source integration to performance tuning in large-scale environments.
1. **Data Pipeline Architecture**: You’ll design and build scalable data ingestion and transformation pipelines, handling both batch and real-time streams.
2. **ETL/ELT Best Practices**: You’ll build robust, efficient workflows using tools like dbt, Apache Airflow, or similar orchestration frameworks.
3. **Workflow Automation Integration**: You’ll collaborate with software and platform engineers to ensure data workflows can incorporate automation logic and business rules (e.g., auto-escalation, anomaly detection).
4. **Quality & Governance**: You’ll enforce data integrity, version control, and security protocols to safeguard data quality.
5. **Performance Optimization**: You’ll diagnose bottlenecks in data processing and implement best practices to improve throughput and reliability.
6. **Mentorship & Team Building**: You’ll lead by example in code reviews, provide guidance to junior engineers, and actively shape a knowledge-sharing culture within the team.
## Qualifications
1. You gained solid experience in **data engineering**, designing **robust and large-scale data solutions**.
2. You are experienced in **Python**, **database interactions** (SQL & NoSQL), using **modern data platforms** (Snowflake, Databricks, or similar), and you have a strong understanding of **dimensional modeling**, **data warehousing concepts**, and **schema design**.
3. Familiarity with real-time streaming (Kafka, Spark, or similar), cloud providers (AWS, Azure, or GCP), containers (Docker), CI/CD pipelines, or energy-sector data is a nice to have.
4. You communicate clearly in **English**. Knowledge of German is a plus.
5. You **embody agile values** and **take ownership** of identifying data issues and implementing robust solutions. You're comfortable with ambiguity, move fast with MVPs, and keep a long-term architectural view in mind.
## Additional Information
Benefits:
* Work in Germany's first green unicorn and actively shape the solar energy revolution.
* The sun shines all over the world - at Enpal you will find a highly motivated and diverse team with more than 65 different nationalities.
* Would you rather keep your pet company at home or your colleagues at the office? Even after the pandemic, we offer you a hybrid working model
* We fulfill every start-up cliché - in our modern office in Berlin-Friedrichshain, you'll find everything your heart desires, from a ping-pong table and yoga corner to a roof terrace and stocked drinks fridges.
* Your kick-start at Enpal - Get to know the company, your team colleagues and our founder Mario on your onboarding day.
* Stay up to date - Whether it's company figures at our monthly all-hands meetings or how a photovoltaic system works at the Lunch & Learn, you'll always know exactly what's going on.
* Energy transition only works together - At Enpal, you can expect a legendary team spirit and unforgettable team events.
* No mistakes, no progress - We live a strong feedback culture and grow with your input, either personally or anonymously via our feedback tool Culture Amp.
At Enpal, we are proud of the diversity of our team. No decisions are made on the basis of skin colour, religion or religious belief, ethnic or national origin, nationality, gender identity, sexual orientation, disability or age, either during recruitment or employment. Enpal stands for a safe workplace and takes action against discrimination and harassment of any kind.