Website:
gokool.digital
Job details:
We are seeking a highly articulate and technically elite Senior Data Engineering & Strategy Consultant. In this role, you will act as a key participant on consulting teams, bridging the gap between high-level data strategy and hands-on execution. You will design, build, and optimize enterprise data platforms using Microsoft Fabric and Azure Data Factory, while ensuring all architectures align with robust Data Governance and Data Quality frameworks.
Key Responsibilities
- 🏛️ Architecture & Data Engineering: Design and implement robust Medallion Architectures (Bronze, Silver, Gold layers) using Microsoft Fabric (Lakehouse, Warehouse, Pipelines, and Dataflows Gen2).
- 📥 Data Ingestion & Pipeline Orchestration: Build highly efficient ETL/ELT pipelines using Azure Data Factory / Fabric Data Pipelines to ingest complex data ecosystems out of Dynamics 365 CE and Dynamics 365 F&O.
- 🔄 Incremental & Delta Ingestion: Build watermark-based ingestion systems utilizing metadata tracking via timestamp keys like ModifiedOn and ModifiedDateTime.
- 📊 Modeling & Reporting Integration: Build high-performance Fact and Dimension tables in the Gold layer using relational and star schema modeling. Align structures to feed Power BI semantic layers seamlessly.
- 🛡️ Data Strategy & Governance: Apply strong knowledge of data governance processes, data quality management controls, master data management (MDM), and reference data management.
- 💼 Consulting Delivery: Collaborate as a senior member of a consulting team to reliably deliver data-related solutions to strict Statements of Work (SOWs).
- 🔍 Troubleshooting & QA: Proactively identify, debug, and resolve pipeline execution errors and data quality issues.
- 🌐 DevOps & Agile Practices: Manage the data lifecycle using Git/DevOps and deployment pipelines within structured Agile/Scrum environments.
Qualifications & Experience Requirements
Consulting & Strategic Experience:
- At least 3 years of practical experience in a consulting-based role (Senior Role) focusing heavily on delivering enterprise data solutions.
- Proven track record of being a key participant in consulting teams delivering directly against corporate SOWs.
- Strong knowledge of high-level data and analytics strategies, including supporting roadmaps, initiatives, and data programs.
- Solid understanding of best-practice data governance frameworks (e.g., DMBOK).
- Experience planning, strategizing, and executing large-scale data migration programs.
Core Technical Stack:
- Microsoft Fabric Expert: In-depth knowledge of OneLake, Lakehouses, Warehouses, Pipelines, and Dataflows.
- Orchestration & Transformation: Deep experience with Azure Data Factory. Expert-level SQL transformation skills (T-SQL, views, complex joins, and stored procedures).
- Source Ecosystems: Prior experience ingesting and transforming data from Dynamics 365 CE and Dynamics 365 F&O.
- Modern Architecture Knowledge: Strong understanding of relational modeling, star schema modeling, Big Data, and Cloud Data Warehouse designs.
Preferred Qualifications:
- 💡 Added Advantage: Practical proficiency with Python or PySpark inside Spark environments for advanced transformations.
- Relevant industry certifications (e.g., DP-600: Implementing Analytics Solutions Using Microsoft Fabric, DP-203, or Data Governance certifications) are highly regarded.
Click on Apply to know more.