WE SPECIALISE IN FINDING FANTASTIC OPPORTUNITIES
FOR DIGITAL AND DATA SPECIALISTS WITH THE MOST INNOVATIVE BUSINESS ACROSS EUROPE AND THE USA.
Up to €70.00 per annum
3 months ago
I am supporting a fast-growing, financially secure SaaS scale up supporting the mobility industry to improve fleet services. Working with live car data, you will join as a Freelance Data Engineer working to:
* Migrate their BI instracture setup from Docker based deployment on AWS EC2 machines running on Amazin Linux 1 (CentOS 7).
* Supporting the migration from python 3.7 to 3.8
* Work on replacing Jenkins as task scheduler for ETL processing with Apache Airflow
* You will set up a Clickhouse Server to analyse the impact of a column store on performance queries for large data sources.
* You will also work on connecting new data sources via API in python.
The ideal candidate will come with:
* Experience with Apache Airflow
* Solid Python programming (Python 3)
* Expeirence connecting API's to build ETL workflows
* Prostgres 11, Git/Gihub and AWS/Linux experience
* Pentaho Data Integrations knowledge is a plus
Remote with 1 day per week onsite in Berlin
Darwin Recruitment is acting as an Employment Business in relation to this vacancy.