Data Streaming Engineer – Azure & Kafka

Pauwels Consulting is hiring a Data Streaming Engineer – Azure & Kafka for a client in the telecommunications sector. The role supports a data transformation program, re-engineering the enterprise data platform and migrating systems to a modern Azure Cloud technology stack. Responsibilities include designing and developing high-availability solutions for real-time data ingestion, processing, and serving; collaborating with architects, data scientists, and project managers; developing generic frameworks for system monitoring and logging; implementing real-time processing workflows; and participating in the migration of on-premises data assets to the cloud.

Requirements: 5+ years of experience in big data and data streaming engineering, profound knowledge of backend development using Java and Python, extensive experience with Azure Cloud services (ADLS, Azure Functions, Event Hub), solid experience with real-time processing frameworks such as Spark Streaming and Kafka Streams, knowledge of NoSQL databases like Couchbase, experience with CI/CD tools (Git, Jenkins, GitHub CI, Nexus), proactive team player with strong analytical and troubleshooting skills, ability to work autonomously and cooperate with onsite and offshore teams, and fluency in English.

Nice to haves: knowledge of Cloudera and Kafka on-premises, experience with Azure Kubernetes Service (AKS), familiarity with Flink or Databricks structured streaming, and knowledge of Dutch and/or French.

Offer: start date ASAP, duration 6 months, full-time, location Brussels, hybrid working model. Contract open to both permanent employees and freelancers.