Lead Data Engineer (Spark)
Posted Updated
Description
Addepto is a leading AI and data engineering company seeking a Data Engineer in Germany. You will develop scalable data platforms and pipelines across automotive, aerospace, and telecom projects, collaborating with cross-functional teams.
Join a team using Python (or Java/Scala), Spark, Cloudera, Airflow, Iceberg, and AWS to deliver high-quality data solutions while supporting clients in a fast-paced consulting environment.
Develop and maintain a high-performance data processing platform for automotive data. Design and implement data pipelines that process large volumes of data in streaming and batch modes. Optimize data workflows using Spark, Cloudera, Airflow; enable scalable data ingestion and storage. Work with data lake tech (Iceberg) to manage structured and unstructured data. Collaborate with cross-functional teams to integrate data sources and requirements. Monitor, troubleshoot, and ensure high availability and performance of data processing; use AWS forSkills
Sign in to read and join the discussion.