As a Data Engineer, you will be part of the Network Automation department within the Technology cluster. You will be responsible for designing, building, and managing data solutions that collect, process, and make large volumes of (streaming) network data available to internal stakeholders.
You will work independently on complex challenges related to data pipelines and the big data platform, managing both the underlying infrastructure and data flows. In addition, you will contribute ideas for platform improvements and advise stakeholders on technical solutions.
Key Responsibilities
-
Design, build, and maintain (streaming) data pipelines and data transformations.
-
Manage and optimize the big data platform, including infrastructure, virtual machines, containers, and supporting tooling.
-
Further develop the platform through upgrades, migrations, and capacity expansions.
-
Implement monitoring for data, pipelines, and the platform to proactively detect and resolve issues.
-
Translate business requirements into technical solutions and advise stakeholders accordingly.
-
Document solutions and ensure quality, security, and compliance standards are met.
-
Work with Kafka and data streaming technologies to process and manage large volumes of real-time data.
-
Manage and support on-premises infrastructure and environments alongside modern data platforms.
Minimum Requirements
-
Experience with streaming data, Kafka, and data transformations.
-
Strong knowledge of data pipeline design, development, and monitoring.
-
Experience with big data platforms and operational platform management.
-
Hands-on experience with data streaming technologies, preferably in large-scale environments.
-
Knowledge of infrastructure, including hardware, virtual machines, operating systems, and containers.
-
Experience working with on-premises infrastructure and environments.
-
Experience within the telecommunications or networking domain is an advantage.
-
Knowledge of data security and relevant regulations, including GDPR.
-
Bachelor’s or Master’s degree (or equivalent level of working and thinking) with approximately 5+ years of relevant experience.
-
Strong analytical skills and the ability to work independently.
-
Excellent communication skills with the ability to advise and influence stakeholders.
Darwin Recruitment is acting as an Employment Agency in relation to this vacancy.
Kiara Cumming