Description

In this role, you will be at the forefront of data management, developing pipelines and ensuring data quality while collaborating with various teams. Your expertise will help shape the data infrastructure and reporting capabilities.

Requirements

• •Familiarity with Kafka, Flink/Spark, HBase, or other relevant Big Data technologies
• •First-hand experience with Data Warehouse/Data Lake, databases
• •Knowledge in database systems, SQL, and data modeling
• •Proficiency in at least one programming language (e.g., Python, Java, Scala, Spark)
• •Experience with Cloudera solutions, both operational and application development
• •Relevant degrees in a technical field of study (e.g. data or computer science)
• •Curiosity about data engineering and problem-solving
• •Excellent analytical and problem-solving skills
• •Strong communication and teamwork abilities
• •Detail-oriented with a commitment to delivering high-quality work

Tasks

• •Develop and maintain data pipelines
• •Work on data modeling and ETL processes
• •Transform data to support data warehousing infrastructure
• •Identify and rectify data anomalies for quality assurance
• •Ensure data accuracy through quality checks
• •Maintain documentation of data pipelines and processes
• •Collaborate with teams to support internal data needs
• •Stay updated on trends in Business Intelligence and Data Warehousing
• •Create ad-hoc reports using SQL and notebooks

Tools & Technologies

Benefits