Flag job

Report

Azure Data Engineer

Min Experience

6 years

Location

Bangalore, KA

JobType

Full Time

About the job

Info This job is sourced from a job board

About the role

About the Role: We are looking for an Azure Data Engineer with 6 years of experience in designing, developing and maintaining ETL/ELT pipelines using Azure Data Factory to be ingesting, transforming and loading data from diverse sources. Requirements: Applies and manages data storage solutions in Azure Data Lake, ensuring efficient data structuring, partitioning and access controls. Develops complex data transformations using PySpark and Python for data processing on distributed systems, ensuring high performance and scalability. Writes optimized and efficient SQL queries to retrieve, manipulate and aggregate large datasets from databases like Azure SQL, Synapse Analytics or other relational systems. Ensures data quality and consistency through proper error handling, logging and data validation checks within the ETL processes. Collaborates with data architects and business stakeholders to understand data requirements, build data models and design optimal solutions. Monitors, troubleshoots and optimizes data pipelines, ensuring data availability, performance and cost-effectiveness. Implements data security, governance, and compliance best practices for data storage and processing in the cloud environment. Participates in DevOps practices, including CI/CD pipelines for deploying data solutions using Azure DevOps or similar tools.

About the company

At HTC Global Services, our culture is an embodiment of who we are - a value-led organization that is committed to the success of all its people and customers. Hybrid and Workplace flexibility Work-Life-Balance Well-defined career development plan Rewards & Recognition program L&D focuses on upskilling Hands-on experience on Emerging Technologies and Digital Transformation Career Mobility programs Be a part of a collaborative and supportive work environment that welcomes out-of-the-box thinking and embraces diversity.

Skills

Azure Data Factory
Databricks