Senior Data engineer
Senior Data engineer voor Vattenfall AB, hybride Amsterdam, 32-40u/week, detachering via HeadFirst.
- Locatie
- Amsterdam
- Werkvorm
- hybride
- Uren
- 32–40 uur per week
- Sluitingsdatum
Eisen
- Design, implement and maintain Azure infra using IAC (Terraform)
- Support containerized workloads using Kubernetes
- Technical background with Python, SQL, Pyspark
- Proven track record in data engineering
- HBO/WO education
- Familiar with Data Warehousing and Data modelling concepts
- Implement RBAC, IAM and security best practices in Azure environment
- Experience working agile
- Working experience with Analytics & BI tools and services, preferably in MS Azure stack
- Understanding of IT Architecture guidelines (TOGAF) and on-premise, cloud & hybrid patterns
- Familiar with CI/CD, testing and version control (Azure DevOps, ARM, GIT), Terraform, bash
- Collaborate with developers to enable cloud native deployments
- Proficient in spoken and written English
Wensen
- Experience in energy sector
- Good understanding of utility business processes and IT landscape (SAP ERP, IAM, EAM, SCADA, GDPR)
Volledige omschrijving
LET OP: ENKEL DETACHERING. Indien gelijkwaardige beloning van toepassing is op de inzet, verwijzen wij naar de onderstaande cao’s en de bijbehorende functieschaal die op deze rol van toepassing is. Leveranciers dienen hier bij het bepalen van het tarief vooraf rekening mee te houden. Tariefsaanpassingen achteraf op basis van deze cao-bepalingen worden niet geaccepteerd.
PLb cao: Cao Productie- en Leveringsbedrijven PLB - FNV; Vattenfall bedrijfs-cao: Bedrijfs-cao Vattenfall 2025-2026; De functie in deze aanvraag valt binnen schaal: 10. Senior Data engineer. The Data Engineer creates the data infrastructure in a simple and efficient matter by design, build and integrate data from various sources. The Data Engineer builds data pipelines from existing data sources and other (on-prem) systems into the Big Data platform; Creates consistent e2e BI solutions with a data lifecycle starting with collecting the needed data until visualizing them; Creates AI/ML models in BigData use cases and helping business to leverage the results; User story creation with good understanding of business processes, product and customer journey; Rates user stories for customer value and to challenge the product owner on prioritization of user stories (e.g., stability versus functionality); User story refinement: Is able to translate user stories into technical stories; Development: Able to design, develop and optimize data storage and data processing solutions and proficient in in one or more program languages like python and SQL to ensure sufficient quality level ,including test criteria; Deployment: Is able to create and execute script based deployments, including rollbacks.
Is able to maintain/setup automated deployment using the VF standard toolset; Operations: Is able to setup automated monitoring and proactive alerting, is able to provide parameters to size the underlying application infrastructure. You will be a member of one of our DevOps teams designing, creating, and maintaining solutions based on the MS Azure technology stack. In doing so, we as IT partner up with our colleagues from the various departments within Vattenfall on a daily basis.
The tasks and projects are varied and so are the data, the use cases and the technology. For instance our solutions have a direct impact on fuel consumption in the district heating grid of Berlin based on live Smart Meter data evaluation, optimize maintenance cycles of turbines and under water cables via predictive maintenance or allow for cross country streaming data analytics on Hydro powerplant sensor data.
Your tasks and responsibilities: Analyzing business needs and translating them into IT specifications; Providing expert advice both internally in the team and to various other departments in Vattenfall. Proactively adapting value adding solutions to the needs of other departments; Designing, building and maintaining data lake solutions to share data within Vattenfall & with external stakeholders; Implementing traditional database & DWH concepts to structure the data in the cloud, on-premise and hybrid to provide self-service reporting solutions (e.g. using PowerBI).
Building and maintaining ETL/ELT tracks and APIs; Working with streaming data analytics together with business stakeholders; Being part of DevOps teams together with architects, requirement engineers, data engineers, data scientists and business specialists. Design robust data models, data warehouses, and data lakes using modern cloud and distributed platforms. Define and implement data quality checks, validation frameworks, and security best practices to ensure data integrity.
Implement security controls, networking, and governance policies using Azure Key Vault, and role-based access control (RBAC). Automate the deployment of data infrastructure and pipelines. As our Platform Data Engineer you: Have working experience with Analytics & BI tools and services, preferably in the MS Azure stack (e.g. Synapse workspaces and dedicated SQL pools, SQL Database, Analysis Services, Function Apps, Event Grid, Event hub, MQTT, stream analytics, Databricks, asset bundles.
Have a technical background with an understanding of how analytics solutions are brought into life by means of preferably but not exclusively Python, SQL, Pyspark. Are familiar with CI / CD, testing and version control (e.g. Azure DevOps, ARM, GIT or similar); Terraform, bash. Are familiar with Data Warehousing and Data modelling concepts; Design, Implement and maintain Azure infra using IAC(Terraform); Implement RBAC, IAM and security best practices in azure environment; Collaborate with developers to enable cloud native deployments; Support containerized workloads using Kubernetes; Have an understanding of IT Architecture guidelines & principles (e.g.
TOGAF) and on-premise, cloud & hybrid architectural patterns; Have experience in working agile; Are proficient in spoken and written English; Ideally you already have a good understanding of utility business processes and their IT landscape (SAP ERP, IAM, EAM, SCADA, infrastructure and security regulations like GDPR).
Practical: HBO/WO; English is the main language we use for communication since the members of our team have different nationalities. We expect the candidates to have a proven trackrecord in the data engineering area. The team is present in the Amsterdam office on Tuesdays and Thursdays and we expect the candidate to also be available in Amsterdam on those days. Experience in the energy sector is a pré.
Je CV en reacties
Voeg een CV toe om de eisen naast jouw ervaring te bekijken.
Heb je zelf bij de bron gereageerd? Leg dat hieronder vast.
Bewaar de broker en datum in Mijn reacties.