Beschreibung

In this role, you will design and maintain data pipelines while collaborating with traders and analysts to ensure accurate and timely data for decision-making. Your work will involve optimizing services on AWS and connecting data to dashboards, making a significant impact on the energy trading platform.

Anforderungen

• •Senior-level engineering experience
• •Strong experience in Data Engineering or Software Engineering
• •Solid understanding of ETL/ELT patterns
• •Hands-on production experience with Airflow and/or Prefect
• •Experience running containerized workloads in production using AWS ECS
• •Proficiency in Python
• •Strong SQL skills
• •Solid working knowledge of AWS services
• •Infrastructure-as-code experience
• •Experience in energy trading, power markets, commodities, or financial markets
• •Familiarity with time-series data
• •Experience operating streaming systems
• •Practical experience with Apache Spark and/or Apache Flink
• •Knowledge of AWS-native streaming tools
• •Experience with data observability and quality checks
• •Exposure to quantitative, forecasting, or optimization systems
• •Strong engineering fundamentals

Aufgaben

• •Design and implement data pipelines
• •Maintain long-running services for energy market data
• •Develop and maintain containerized services on ECS
• •Build and orchestrate workflows using Airflow or Prefect
• •Apply software engineering best practices, including modular design and testing
• •Conduct code reviews and manage versioning
• •Design analytics-ready data models for trading and performance reporting
• •Collaborate with traders and analysts to define metrics and data contracts
• •Connect curated datasets to dashboards and BI tools like Grafana
• •Ensure data correctness and availability for dashboards
• •Implement monitoring and alerting for pipelines and services
• •Optimize performance and cost across AWS components
• •Document systems and data models for self-service analytics

Tools & Technologien

Benefits