Programmers.io
Website:
programmers.io
Job details:
Job Description
We are seeking a highly skilled Azure & Snowflake Data Engineer to design, build, and optimize scalable data solutions using Microsoft Azure and Snowflake. The ideal candidate will have hands-on experience in cloud-based data engineering, data warehousing, ETL/ELT development, and modern data architecture. The role involves collaborating with business stakeholders, data analysts, and data scientists to deliver robust and high-performance data platforms.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF), Azure Databricks, and Snowflake.
- Develop and optimize ETL/ELT processes for ingesting, transforming, and loading structured and unstructured data.
- Implement data models, data marts, and enterprise data warehouse solutions in Snowflake.
- Integrate data from multiple sources, including databases, APIs, cloud storage, and third-party applications.
- Ensure data quality, governance, security, and compliance across data platforms.
- Optimize Snowflake performance through clustering, partitioning, query tuning, and warehouse management.
- Build and maintain CI/CD pipelines for data engineering workflows.
- Monitor and troubleshoot data pipelines, system performance, and data processing issues.
- Collaborate with analytics, BI, and business teams to understand data requirements and deliver solutions.
- Create technical documentation, design specifications, and operational procedures.
- Implement data security using role-based access control (RBAC) and data masking policies.
Must-Have Skills
ADB, AZF, Snowflake, SQL, ETL, Data warehouse
Click on Apply to know more.