DataBricks – Senior Programmer Analyst (Exp: 3+ Yrs to 5 Yrs)
Bilvantis Technologies
- Location
- Hyderabad, Telangana, India
- Job type
- Full-time
Required skills
- Python
- Agile
- Airflow
- AWS
- Apache
- Apache Airflow
- Apache Spark
- Azure
- containerization
- Databricks
- DevOps
- Docker
- ETL
- Git
- infrastructure-as-code
- Kubernetes
- Spark
- SQL
- Terraform
- version control
- Unity
- SDLC
About the role
Bilvantis Technologies
Website:
bilvantis.io
Job details:
Job Description: DataBricks – Senior Programmer Analyst (Exp: 3+ Yrs to 5 Yrs)
We are seeking a talented and motivated DataBricks expert to join our team as a Senior Programmer Analyst.
Required Skills & Qualifications
- 3 to 5 years of hands-on experience in data engineering, software development, or cloud data platform delivery.
- Expert-level Apache Spark (PySpark) skills.
- Strong proficiency in SQL.
- Solid programming skills in Python for automation and data processing.
- Hands-on experience with a major cloud platform such as Microsoft Azure (Azure Data Factory, ADLS) or AWS.
- Experience with workflow orchestration tools like Databricks Workflows, Delta Live Tables (DLT), or Apache Airflow.
- Experience with Infrastructure-as-Code (Terraform).
- Experience with containerization tools (Docker / Kubernetes).
- Build and support Databricks data pipelines for enterprise analytics.
- Understanding of the SDLC and Agile methodologies.
- Communication with the customer and producing the daily status report.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
- Databricks Certified Data Engineer Associate or Professional certification.
- Should have good oral and written communication.
- Should be a good team player and able to work with business stakeholders.
- Should be proactive and adaptive.
Key Responsibilities
- Design, build, and maintain scalable ETL/ELT data pipelines using Databricks and Apache Spark to support enterprise analytics.
- Transform, validate, and optimize large datasets using PySpark and advanced SQL.
- Implement and maintain Delta Lake and the lakehouse/medallion architecture (bronze, silver, gold layers).
- Work with data analysts, data scientists, and business stakeholders to define data requirements and deliver trusted datasets.
- Implement DevOps practices, version control (Git), and deployment automation for data pipelines.
- Apply access controls, data quality frameworks, and data governance using tools like Unity Catalog.
Click on Apply to know more.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.
