Databricks Engineer - Lead / Manager

Blend

Location: Hyderabad, Telangana, India
Job type: Full-time

Required skills

Python
Apache
Apache Spark
Artificial Intelligence
Azure
CSV
data lake
data modeling
data science
Databricks
DevOps
ETL
Git
JSON
Kafka
Parquet
Spark
SQL
version control

About the role

Blend

Website: blendapp.in
Company: https://www.linkedin.com/company/blend360
Seniority: Mid-Senior level
Industries: Advertising Services
Job details:

Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com.

Job Description

We are looking for an experienced Azure Databricks Engineer with strong hands-on expertise in Python, SQL, and Apache Spark to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate should have experience working with large datasets, distributed data processing, and modern data engineering practices.

Responsibilities

Design, develop, and maintain scalable data pipelines using Azure Databricks

Implement ETL/ELT workflows using PySpark, Spark SQL, and Python

Optimize Spark jobs for performance, cost, and scalability

Work with structured and semi-structured data (Parquet, Delta, JSON, CSV)

Build and manage Delta Lake tables (ACID, time travel, schema evolution)

Integrate Databricks with Azure Data Lake Storage (ADLS Gen2)

Develop complex queries and transformations using SQL

Collaborate with data scientists, analysts, and stakeholders to support analytics and ML use cases

Ensure data quality, validation, and monitoring

Follow best practices for security, access control, and governance in Azure

Qualifications

6+ years of experience in Data Engineering

Strong hands-on experience with Azure Databricks

Proficiency in Python for data processing

Strong knowledge of SQL (joins, window functions, performance tuning)

Hands-on experience with Apache Spark / PySpark

Experience working with Delta Lake

Knowledge of Azure Data Lake Storage (ADLS Gen2)

Understanding of distributed computing concepts

Experience with Git version control

Additional Information

Experience with Azure Data Factory

Exposure to CI/CD pipelines (Azure DevOps, GitHub Actions)

Basic understanding of data modeling

Familiarity with cloud security and RBAC in Azure

Exposure to streaming data (Spark Structured Streaming, Event Hub, Kafka)

Click on Apply to know more.

This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.

Databricks Engineer - Lead / Manager

Similar jobs