Data Platform Engineer – 12 months – Remote

• Location: #Remote (based in Europe)
• Availability: Full-time
• Contract Duration: 12 months
• Start Date: January 2025

Our client is seeking an experienced Data Platform Engineer to join their team on a Freelance basis.

Key Responsibilities:

• Airflow Infrastructure Management: Optimize and maintain workflows on Kubernetes-based platforms, ensuring scalability and reliability.
• Data Migration Efforts: Plan and execute migrations to new orchestration platforms (e.g., Astronomer, AWS).
• Data Catalogue Enhancement: Manage LinkedIn DataHub to ensure accurate metadata integration and governance.
• Databricks Configuration: Set up and optimize Databricks infrastructure, leveraging tools like Spark and Delta Lake.
• Monitoring and Reporting: Track infrastructure health, resolve issues, and provide actionable insights.
• Optional On-Call Support: Address critical incidents to minimize downtime.

Desired Skills and Experience:

• Expertise in Airflow, Kubernetes, and data orchestration tools (e.g., Astronomer, MWAA).
• Strong background with big data tools (e.g., Spark, DBT) and cloud platforms (AWS).
• Proficiency in Databricks infrastructure and advanced features like Delta Lake.
• Experience in data migrations and managing metadata systems (e.g., LinkedIn DataHub).
• Strong problem-solving skills and adherence to software development best practices (CI/CD, version control).

Interested?
If this role is of interest, please send an up-to-date CV to taylor.lewis@darwinrecruitment.com

Darwin Recruitment AG is a Zurich based, SECO licensed, privately owned subsidiary of Darwin Professional Staffing Group Ltd (a Global IT Recruitment Consultancy).

Darwin Recruitment AG manages client relationships whilst also utilising Darwin Professional Staffing Group databases and networks to source Candidates and fulfil client requests.

We do not ask for a placement fee from Candidates/Employees.

If you wish to contact a specialist regarding this role, or your job search in general, please contact +41 (0)43 456 29 09

Taylor Lewis