Netsmartz
Website:
netsmartz.com
Job details:
Role Overview :
We are looking for a highly skilled Azure Data Engineer to design, build, and optimize scalable data platforms leveraging Microsoft Fabric, Azure Data Factory, ADLS Gen2, and PySpark. The ideal candidate will have strong experience in modern data warehousing, Lakehouse architecture, and large-scale data transformation. You will play a critical role in building enterprise-grade analytics solutions, enabling high-volume data processing, and delivering reliable, scalable data pipelines to support business intelligence and advanced analytics
Key Responsibilities:
Data Platform Architecture & Engineering Design and implement scalable analytics solutions using Microsoft Fabric including:
• Lakehouse
• Warehouse
• OneLake
Develop and maintain Lakehouse architectures aligned with modern data engineering best practices Design analytical schemas, semantic data models, and optimized storage patterns
Data Ingestion & Pipeline Development Build and orchestrate data ingestion pipelines using: • Microsoft Fabric Notebooks
• Data Pipelines
• Dataflows Gen2
• Azure Data Factory (ADF)
Configure and manage Linked Services and integration runtimes Develop ingestion frameworks capable of handling TB-scale batch and near-real-time data
Data Transformation & Processing Develop and optimize transformations using:
• PySpark
• SQL
• Delta Tables
Implement incremental load strategies, CDC patterns, and data reconciliation frameworks Design high-performance ETL/ELT pipelines for large-scale dataset
Data Storage & Optimization Design and manage scalable ADLS Gen2 storage architectures Implement:
• Partitioning strategies
• Clustering approaches
• File format optimization (Parquet / Delta)
• Optimize storage and query performance for high-throughput workloads
Required Skills & Qualifications Experience
• 5 to 8 years of experience in Data Engineering or Cloud Data Platform roles
• Hands-on experience designing and deploying Azure-based analytics solutions
Technical Skills
• Microsoft Azure & Fabric
• Strong hands-on experience with:
• Microsoft Fabric (Lakehouse, Warehouse, OneLake)
• Azure Data Factory (ADF)
• ADLS Gen2
• Linked Services configuration
Click on Apply to know more.