UST
Website:
ust.com
Job details:
Azure Data Factory (ADF) Engineer
We are seeking a skilled Azure Data Factory (ADF) Engineer to join our offshore data engineering team. The ideal candidate will have 7+yrs of strong hands-on experience in building, optimizing, and supporting data integration solutions using Azure Data Factory, along with solid expertise in SQL Server, DevOps CI/CD practices, and secure authentication and authorization using Microsoft Entra ID (Azure AD).
Key Responsibilities
- Design, develop, and maintain scalable and reliable data pipelines using Azure Data Factory (ADF).
- Implement and optimize ETL/ELT workflows to ensure high performance, reliability, and scalability.
- Work extensively with SQL Server for data ingestion, transformation, querying, and performance tuning.
- Build and maintain CI/CD pipelines using Azure DevOps (ADO) or GitHub Actions for automated deployments and environment promotions.
- Implement and manage secure authentication and authorization mechanisms using Microsoft Entra ID (Azure AD) to ensure compliance and data security.
- Collaborate with cross-functional teams including data engineers, architects, DevOps, and business stakeholders to deliver high-quality data solutions.
- Monitor, troubleshoot, and resolve issues related to data pipelines, integrations, and production failures.
- Support end-to-end ownership of data pipelines, including development, deployment, monitoring, and optimization.
Must-Have Skills
- Azure Data Factory (ADF):
- Advanced hands-on experience in building, orchestrating, and managing ADF pipelines, including parameterized and reusable designs.
- SQL Server:
- Strong expertise in writing complex queries, stored procedures, indexing strategies, and performance tuning.
- DevOps / CI-CD:
- Proven experience creating and maintaining CI/CD pipelines using Azure DevOps or GitHub Actions.
- Authentication & Authorization:
- Hands-on experience implementing secure access controls using Microsoft Entra ID (Azure AD).
Nice-to-Have Skills
- Snowflake:
- Familiarity with Snowflake data warehousing concepts and integration patterns.
- SSIS (SQL Server Integration Services):
- Experience working with or migrating legacy SSIS-based ETL solutions.
Click on Apply to know more.