Senior Data Engineer – Fixed term contract (ANÜ) – Berlin / Hybrid
Urgent hire – interviews happening immediately
Overview
A platform engineering team is building a new backend data layer to guarantee data availability and power internal analytics for customer account managers. After a period of significant change, the team is expanding to meet fast-growing demand. They are seeking a Senior Data Engineer to partner closely on data modeling and pipeline development.
Why this role
You will help design and implement the foundation for a high-performance analytical platform. Your work will enable fast, reliable queries across large datasets and directly support internal applications used by account managers worldwide.
Key Responsibilities
-
Model and build data structures optimised for fast analytical queries (star-schema / OLAP).
-
Design, develop, and maintain batch data pipelines to move and transform large datasets.
-
Define targets and implement efficient batch processing workflows.
-
Collaborate with stakeholders to understand requirements and clearly explain technical concepts.
-
Ensure data quality, integrity, and security while optimising performance and scalability.
-
Troubleshoot and resolve pipeline or processing issues.
Required Skills
-
Spark SQL expertise for large-scale data processing (primary tool).
-
Strong background in batch processing and target definition.
-
Competent Python programming skills.
-
Clear communicator, comfortable engaging with technical and non-technical stakeholders.
-
Understanding of ETL/ELT paradigms and data modeling principles.
Nice to Have
-
Experience with streaming data and event-driven architectures (Kafka or similar).
-
Background in software engineering for long-term platform development.
-
Familiarity with OLAP engines or columnar databases such as ClickHouse.
Contract Details
-
Work setup: Hybrid, with ability to be in Berlin 1-2 days per week strongly preferred.
-
Start: As soon as possible.
Interview Process
-
Panel Interview – broad discussion of background and experience.
-
Technical Interview – deep dive into data engineering and Spark SQL expertise.
-
Final Interview (if required) – to address any remaining questions.
Darwin Recruitment is acting as an Employment Business in relation to this vacancy.
Alex Hevey