Report

Data Engineer

Salary

₹15 - 50 LPA

Min Experience

4 years

Location

Bangalore

JobType

full-time

About the job

Info This job is sourced from a job board

About the role

Experience: Minimum 3-5 years of hands-on experience as a Data Engineer.
Python Proficiency: Demonstrated expertise with Python for data engineering tasks (validated during interview).
Cloud Experience: Hands-on experience with Azure cloud services (preferred) or other cloud platforms.
Tools & Technologies: Experience with Airflow, Azure Data Factory, Azure Databricks, Docker, Kubernetes, and CI/CD tools.
Data Management: Proven experience handling large-scale data operations (terabytes/petabytes).
Databases: Strong knowledge of SQL/NoSQL databases and experience in implementing data lakes/warehouses.
Orchestration: Experience with job orchestration tools like Apache Airflow.
Web Scraping (Optional): Experience with Selenium for data ingestion.
Resource Management: Capable of managing clusters and optimizing resources for data processing.

Data Engineering

Python

Docker

Kubernetes

CICD

Microsoft Azure

Azure Data Lake

Azure Databricks

Azure Data Factory