XML International
Website:
xmlinternational.com
Job details:
Senior Data Engineer | Azure Databricks, ADF & PySpark
📍 Bangalore, India
🏢 On-site
Build Scalable Data Solutions on Microsoft Azure
We are looking for an experienced Senior Data Engineer to design, build and deliver scalable end-to-end data solutions within a large enterprise environment.
This is a hands-on engineering role centred around Azure Databricks, Azure Data Factory, PySpark, Python and SQL, building modern data pipelines and platforms that support analytics and business-critical decision-making.
You'll also act as a technical subject matter expert, helping shape engineering best practices and mentoring junior engineers.
What You'll Do
- Design and implement scalable end-to-end Azure data engineering solutions.
- Build and optimize data pipelines, ingestion frameworks and ETL/ELT processes.
- Develop data solutions using Azure Databricks, PySpark, Apache Spark, Python, SQL and Azure Data Factory.
- Design data models, warehouses and data lake solutions using ADLS Gen2, Delta Lake and Azure Synapse.
- Build robust data integration and ingestion solutions across multiple source systems.
- Perform complex data transformation, cleansing and processing.
- Ensure data platforms are scalable, secure, reliable and maintainable.
- Translate business requirements and data strategy into production-ready technical solutions.
- Collaborate with Product Owners, Solution Architects, Data Architects and business stakeholders.
- Act as a technical SME and provide guidance on data engineering practices and technology choices.
- Mentor junior Data Engineers and promote engineering standards.
- Contribute to CI/CD, DevOps, testing and monitoring practices.
- Troubleshoot complex data and technical issues and drive root-cause analysis.
What We're Looking For
✔ Strong hands-on Azure Data Engineering experience.
✔ Advanced experience with Azure Databricks.
✔ Strong PySpark / Apache Spark expertise.
✔ Strong programming capabilities in Python and SQL.
✔ Hands-on Azure Data Factory (ADF) experience.
✔ Advanced knowledge of ETL/ELT, Data Modeling and Data Integration.
✔ Experience with ADLS Gen2 and Delta Lake.
✔ Experience with Azure Synapse and SQL databases.
✔ Experience designing and processing large-scale data solutions.
✔ Experience with GitHub Actions and/or Azure DevOps.
✔ Strong analytical, troubleshooting and problem-solving capabilities.
✔ Ability to work effectively with technical and business stakeholders.
✔ Experience providing technical guidance or mentoring other engineers.
Additional Technologies
Experience across some of the following would also be valuable:
Kafka | Unity Catalog | Power BI | Azure Functions | Logic Apps | REST APIs | Stream Analytics | Airflow | AWS Glue | Kinesis | Redshift | SonarQube | PyTest
Project Environment
You'll contribute to a major enterprise data programme supporting a global credit risk solution, helping build the data foundations required for exposure management, collateral management, credit monitoring, counterparty data and analytics.
Interested?
If you're a hands-on Senior Data Engineer with deep expertise across Azure Databricks, ADF and PySpark, we'd like to hear from you.
Apply today with your updated CV.
Click on Apply to know more.