Hunt Remotely
Website:
huntremotely.com
Job details:
We are seeking an experienced
Azure Databricks Engineer to design, build, and optimize scalable data pipelines and analytics solutions. You will work on the Azure cloud platform to process large datasets using distributed computing.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Databricks.
- Implement ETL/ELT workflows using PySpark, Spark SQL, and Python.
- Optimize Spark jobs for performance, cost, and scalability.
- Build and manage Delta Lake tables including ACID, time travel, and schema evolution.
- Collaborate with data scientists and stakeholders to support analytics and ML use cases.
Requirements
- 6+ years of experience in Data Engineering.
- Strong hands-on expertise with Azure Databricks and Apache Spark.
- Proficiency in Python for data processing.
- Strong knowledge of SQL (joins, window functions, performance tuning).
- Experience with Azure Data Lake Storage (ADLS Gen2) and Delta Lake.
Click on Apply to know more.