Apply now
Apr 25, 2024 39749

Senior Data Engineer (m/f/d)

Engineers & Developers Advanced Berlin, Germany Remote (EEA)

About the job

We are hiring a Senior Data Engineer for our client, a world-class mobility innovator shaping the future of transportation. Join our client´s dynamic team in Hamburg or Berlin.
You will be instrumental in developing a cutting-edge Data Mesh architecture as our client transitions to this new system.

Responsibilities

  • Collaborate with cross-functional teams, including data analysts, data scientists, and software engineers, to gather data requirements and engineer optimal data solutions within a Data Mesh framework.
  • Design, develop, and maintain scalable data products that seamlessly integrate diverse data sources into the Data Mesh architecture.
  • Craft and oversee data models tailored to the needs of data users while ensuring compliance with data governance and security protocols.
  • Develop data quality monitoring frameworks to guarantee the integrity, accuracy, and reliability of data.
  • Keep abreast of the latest industry trends in Data Engineering and Data Mesh to enhance data pipelines and operational processes continually.
  • Construct high-performance APIs for querying data from the data warehouse.
  • Conduct data analyses to diagnose and resolve data-related issues, aiding in the remediation of such discrepancies.

Skills

Apache Kafka Apache Spark AWS Databricks Hive Python Scala SQL Trino

Qualifications

  • Advanced knowledge of at least one programming language and are happy to learn more. Core languages are Scala and Python.
  • Deep understanding of SQL, databases, and the construction of data pipelines, with a hands-on approach to crafting custom ETL processes.
  • Familiarity with distributed systems, Lambda architecture, AWS S3, and AWS CloudWatch.
  • Experience with AWS, Hive, Spark, Trino, and Databricks is beneficial.
  • Proficiency in stream processing frameworks such as Spark structured streaming and Kafka streams.
  • Ability to interpret and fulfil requirements beyond the explicit written instructions, ensuring optimal user experiences across APIs, internal tools, and customer-facing features.
  • Fluent in Business English, both written and spoken.

Benefits

  • Fully remote or hybrid working models
  • Subsidised gym membership
  • Sabbatical & time off
  • Partner product discounts
  • Birthday-off
  • Employee assistance program
  • Mobility budget

Not the right role?

Discover your dream job. Start by creating your profile and let companies apply to you.

Create a job profile