Senior Data Engineer (m/f/d)

We are hiring a Senior Data Engineer for our client, a world-class mobility innovator shaping the future of transportation. Join our client´s dynamic team in Hamburg or Berlin.
You will be instrumental in developing a cutting-edge Data Mesh architecture as our client transitions to this new system.

• Collaborate with cross-functional teams, including data analysts, data scientists, and software engineers, to gather data requirements and engineer optimal data solutions within a Data Mesh framework.
• Design, develop, and maintain scalable data products that seamlessly integrate diverse data sources into the Data Mesh architecture.
• Craft and oversee data models tailored to the needs of data users while ensuring compliance with data governance and security protocols.
• Develop data quality monitoring frameworks to guarantee the integrity, accuracy, and reliability of data.
• Keep abreast of the latest industry trends in Data Engineering and Data Mesh to enhance data pipelines and operational processes continually.
• Construct high-performance APIs for querying data from the data warehouse.
• Conduct data analyses to diagnose and resolve data-related issues, aiding in the remediation of such discrepancies.

• Advanced knowledge of at least one programming language and are happy to learn more. Core languages are Scala and Python.
• Deep understanding of SQL, databases, and the construction of data pipelines, with a hands-on approach to crafting custom ETL processes.
• Familiarity with distributed systems, Lambda architecture, AWS S3, and AWS CloudWatch.
• Experience with AWS, Hive, Spark, Trino, and Databricks is beneficial.
• Proficiency in stream processing frameworks such as Spark structured streaming and Kafka streams.
• Ability to interpret and fulfil requirements beyond the explicit written instructions, ensuring optimal user experiences across APIs, internal tools, and customer-facing features.
• Fluent in Business English, both written and spoken.

• Fully remote or hybrid working models
• Subsidised gym membership
• Sabbatical & time off
• Partner product discounts
• Birthday-off
• Employee assistance program
• Mobility budget