Flag job

Report

Senior Data Developer - Azure Databricks+cosmos DB + SQL + ETL+SSIS

Min Experience

8 years

Location

Chennai, Tamil Nadu, India

JobType

Full-Time

About the role

We are seeking an experienced Senior Data Developer to join our data engineering team responsible for building and maintaining complex data solutions using Azure Data Factory (ADF), Azure Databricks, and Cosmos DB. The role involves designing and developing scalable data pipelines, implementing data transformations, and ensuring high data quality and performance. The Senior Data Developer will work closely with data architects, testers, and analysts to deliver robust data solutions that support strategic business initiatives. The ideal candidate should possess deep expertise in big data technologies, data integration, and cloud-native data engineering solutions on Microsoft Azure. This role also involves coaching junior developers, conducting code reviews, and driving strategic improvements in data architecture and design patterns. Key Responsibilities Data Solution Design and Development: - Design and develop scalable and high-performance data pipelines using Azure Data Factory (ADF). - Implement data transformations and processing using Azure Databricks. - Develop and maintain NoSQL data models and queries in Cosmos DB. - Optimize data pipelines for performance, scalability, and cost efficiency. Data Integration and Architecture: - Integrate structured and unstructured data from diverse data sources. - Collaborate with data architects to design end-to-end data flows and system integrations. - Implement data security, governance, and compliance standards. Performance Tuning and Optimization: - Monitor and tune data pipelines and processing jobs for performance and cost efficiency. - Optimize data storage and retrieval strategies for Azure SQL and Cosmos DB. Collaboration and Mentoring: - Collaborate with cross-functional teams including data testers, architects, and business analysts. - Conduct code reviews and provide constructive feedback to improve code quality. - Mentor junior developers, fostering best practices in data engineering and cloud development.

About the company

UPS is a global leader in logistics, offering a broad range of solutions that include transportation, distribution, supply chain management, and e-commerce. Founded in 1907, UPS operates in over 220 countries and territories, delivering packages and providing specialized services worldwide. Our mission is to enable commerce by connecting people, places, and businesses, with a strong focus on sustainability and innovation.

Skills

Azure Data Factory (ADF)
Azure Databricks
Microsoft Azure
Data Lake Storage
Cosmos DB
NoSQL data modeling
Data warehousing
Python
SQL
PySpark