Azure Devops Engineer (Synapse)
8 to 12 years of experience in Data Warehouse development, including at least 3-5 years in Azure Synapse, SQL Data Warehouse, or Dedicated SQL Pool || IST (9:30-6:30) || Remote || Very Immediate.
Azure Synapse Technical Lead (Sr. Hands-On Developer). Responsible for overseeing the entire lifecycle of a data mart, including data requirement analysis, design, and development of Azure Synapse pipelines, as well as setting up workflows and dependency flows.
Responsibilities
- Design and develop pipelines from scratch based on existing requirements; analyze existing report queries and database procedures/functions in SQL Server.
- Enhance and optimize existing Synapse pipelines for performance and high data quality.
- Set up dependencies between external and internal job processes to ensure end-to-end system integrity.
- Develop and customize Synapse pipelines according to end-user requirements.
- Develop ETL/ELT load processes
- Analyze source system data structures and fields.
- Extract data from source systems using big data technologies (Spark Pool).
- Create data mapping documentation, including transformation rules, default values, and selection criteria.
- Implement, program, and configure transformation rules, as well as structure/field/value mapping.
- Evaluate the quality of data in the data warehouse/Data Mart.
- Manage source code control, Pull Requests, and Code Reviews.
Required Qualifications
- 8 to 12 years of experience in Data Warehouse development, including at least 3-5 years in Azure Synapse, SQL Data Warehouse, or Dedicated SQL Pool.
- Hands-on ETL coding experience in at least 2 projects as a Team Member or Team Lead, focusing on ETL coding using Azure Synapse, SQL Data Warehouse, or Dedicated SQL Pool.
- Experience in designing and developing Synapse Pipelines for STAR Schemas (Type 1, Type 2, Role-Playing Dimensions, Facts) in at least 2 projects.
- Proficiency in working with relational and big data technologies such as SQL Server, Oracle, SQL Pool, and Spark Pool.
- Strong ability to communicate with business teams using business language.
- Knowledge of Project Management Methodologies and principles.
- Experience with billing and revenue management.
(ref:hirist.tech)
