Data Engineer – Azure Databricks & Power BI

Pauwels Consulting, on behalf of a leading organization in the public transport sector, is looking for an experienced Data Engineer to strengthen their Data & Analytics team. The project focuses on delivering strategic data use cases on an Azure Databricks platform, bridging data engineering and data science to industrialize models for production.

Responsibilities: design, develop, and optimize data pipelines using Azure Databricks and Azure Data Factory; industrialize models and indicator calculations to ensure reliable production through scheduling, monitoring, and quality checks; build and support Power BI reports including data modeling, DAX measures, and performance optimization; refine and validate existing anomaly detection models using statistical methods and Isolation Forest; collaborate with stakeholders to translate business requirements into technical deliverables; document data flows and calculation logic.

Requirements: 5+ years of experience in data science and data engineering; strong expertise with Azure Databricks and Azure services including Data Factory, Storage, Key Vault, and Azure DevOps; in-depth experience with Spark, PySpark, and Delta Lake within Lakehouse architectures; advanced proficiency in SQL and Python libraries such as pandas and scikit-learn; proven track record building Power BI reports including semantic modeling, DAX, and visual design; knowledge of statistics and machine learning, specifically anomaly detection techniques; ability to quickly understand and take over existing code bases and models; proactive, solution-oriented, strong communication skills; fluent in English with native or bilingual proficiency in Dutch or French.

Nice to haves: MLOps practices (MLflow, model versioning, CI/CD); Databricks, Azure (DP-100), or Power BI (PL-300) certifications; basic SAP knowledge with S/4HANA; Agile/Scrum experience; background in public transport, mobility, or energy sectors.

Offer: start date 15/10/2026, duration 3 months (until 31/12/2026) with possible extension, full-time, location Brussels, hybrid working model (at least three days a week onsite), contract open to both permanent employees and freelancers.