Teamware Solutions
Website:
teamwaresolutions.net
Job details:
Microsoft Fabric Engineer
We are seeking a Senior Data Engineer with strong Microsoft Fabric expertise and hands‑on PySpark skills to lead the migration of analytics and data engineering workloads into the Fabric ecosystem. You will assess current-state platforms, design future-state architecture on Fabric (Lakehouse, Warehouse, Data Factory, Real-Time Analytics, Power BI integration), and drive end‑to‑end migration, performance tuning, and operational readiness.
Key Responsibilities
🔹Own end‑to‑end migration of data pipelines, models, and analytical workloads into Microsoft Fabric.
🔹Assess existing estates (e.g., ADF, Synapse, Databricks, Snowflake, on‑prem) and define migration strategy, roadmap, and cutover plans.
🔹Design and implement Fabric Lakehouse architectures (Delta/Medallion), Warehouses, and Data Engineering pipelines using Data Factory, Dataflows Gen2, and Notebooks.
🔹Build and optimize PySpark/SQL code for ingestion, transformation, and enrichment on Fabric Spark.
🔹Establish CI/CD and DevOps practices for Fabric (Git integration, environments, deployment pipelines).
🔹Implement data governance, security, and compliance (workspaces, capacities, permissions, Purview lineage where applicable).
🔹Set up monitoring, observability, and cost/capacity management; tune pipelines and queries for performance and reliability.
🔹Partner with BI teams on Power BI datasets/models and ensure performant end‑to‑end analytics.
🔹Lead testing and validation (schema mapping, data quality checks, reconciliation), and coordinate cutover and hypercare.
🔹Document architecture, patterns, and runbooks; enable and mentor engineering and analytics teams on Fabric best practices.
🔹Engage stakeholders, manage risks, and communicate progress to technical and business audiences.
Required Qualifications
🔹6+ years in data engineering/analytics with a strong track record migrating workloads to modern cloud platforms.
🔹1–2+ years working with Microsoft Fabric components or equivalent experience in Synapse/Databricks plus proven Fabric adoption.
🔹Strong PySpark development skills for ETL/ELT, optimization, and troubleshooting.
🔹Advanced SQL (T‑SQL/ANSI SQL), delta/partitioning strategies, and Lakehouse/Medallion architecture.
🔹Hands‑on with Fabric features: Lakehouse, Warehouse, Data Engineering (Notebooks/Spark), Data Factory, Dataflows Gen2, OneLake, and Git integration.
🔹Solid understanding of Power BI integration with Fabric (datasets, Direct Lake, semantic models).
🔹Experience with Azure ecosystem: ADLS/OneLake concepts, Entra ID (Azure AD), Key Vault, Event Hub/Eventstream (nice), networking/security basics.
🔹CI/CD with Azure DevOps or GitHub; environment promotion and release management.
🔹Strong stakeholder management, planning, and communication; ability to lead cross‑functional migration efforts.
🔹Bachelor’s in Computer Science, Engineering, or related field (or equivalent experience).
Preferred/Good to Have
🔹Microsoft Certified: Fabric Analytics Engineer Associate (DP‑600) and/or Azure Data Engineer Associate (DP‑203).
🔹Prior migrations from Synapse/ADF/Databricks/Snowflake/on‑prem (SSIS/SQL Server) into Fabric.
🔹DAX/Power BI modeling familiarity for end‑to‑end solutioning.
🔹IaC exposure (Bicep/Terraform) for Azure services where applicable; scripting in Python/PowerShell.
🔹Experience with Agile/Scrum and working in product‑centric teams.
Click on Apply to know more.