continue to candidate homepage




Continue to client homepage

Python and PySpark Engineer

  • Location

    Zürich, Switzerland

  • Sector:


  • Job type:


  • Salary:


  • Contact:

    Kristina Marzohl

  • Email:


  • Job ref:

    JN -092021-89340_1631206829

  • Published:

    4 months ago

  • Expiry date:


  • Startdate:


  • Consultant:


Python and PySpark Engineer

We are searching for a strong and experience Python engineer who has demonstrable experience implementing robust, reliable and successful data processing solutions using PySpark.

You will join a large project, which is transforming our Group Finance department to be cloud native. The business area handles large amounts of financial data. Our pipeline needs to support high concurrency, accuracy and low latency when preparing and serving the data to consumers.

We are targeting the Microsoft Azure cloud, where we prefer Platform as a Service (PaaS). A key platform for us is Azure Databricks, which will form the core of our data processing pipeline.

In this role you will:

* work closely with Product Owners and Architects to understand requirements, formulate solutions and evaluate the implementation effort

* design, develop and maintain scalable data transformation pipelines

* assist stakeholders with data-related functional and technical issues

You will have:

* bachelor's degree level or equivalent in Computer Science or similar discipline

* at least 5 years of experience working with large scale software systems

* proficiency in Python/PySpark (batch and streaming)

* proficiency in SQL (Synapse/Azure DWH experience is a plus)

* practical experience with scalable 'big data' data stores (Azure Data lake preferably)

* practical experience working with (and securing) large data sets on enterprise data platforms and distributed computing (Spark)

* practical experience applying automated testing and modern deployment practices on the for mentioned platforms, including Azure DevOps

* experience in the finance sector

About the project:

* Start - ASAP or negotiable

* Duration- 6+ months

* Home Office- also possible

Candidate applications from Switzerland and EU/EFTA are welcome.

Darwin Recruitment AG is a Zurich based, SECO licensed, privately owned subsidiary of Darwin Professional Staffing Group Ltd (a Global IT Recruitment Consultancy).

Darwin Recruitment AG manages client relationships whilst also utilising Darwin Professional Staffing Group databases and networks to source Candidates and fulfil client requests.

We do not ask for a placement fee from Candidates/Employees.