Website:
Job details:
Experience- Minimum 4 years
Budget- Upto 10 LPA
Location: Gurgaon
Immediate joiners
Experience Required: Minimum 4 years
Job Summary:
We are looking for a skilled Data Engineer with strong expertise in ETL processes, data
pipelines, and backend development. The ideal candidate should be proficient in SQL and
Python, experienced with cloud platforms like Azure, AWS, and Databricks, and capable of
building scalable data systems and APIs.
Key Responsibilities:
- Design, develop, and maintain robust ETL (Extract, Transform, Load) pipelines
- Build and optimize scalable data pipelines for large datasets
- Write efficient and optimized SQL queries
- Develop Python-based data workflows and automation scripts
- Design, develop, and maintain RESTful APIs for data access and integration
- Integrate APIs with data pipelines and external systems
- Work with cloud platforms such as Azure, AWS, and Databricks
- Schedule, monitor, and optimize batch and real-time data jobs
- Ensure data quality, validation, and integrity across pipelines
- Collaborate with cross-functional teams (engineering, analytics, business)
- Troubleshoot and resolve data pipeline, ETL, and API-related issues
Required Skills:
- Strong experience in ETL development and data pipeline design
- Proficiency in SQL and Python
- Hands-on experience with Azure, AWS, and Databricks
- Solid experience in building and consuming REST APIs
- Experience with frameworks like FastAPI / Flask / Django
- Experience with workflow orchestration tools (Airflow, ADF, or similar)
- Knowledge of job scheduling and automation
- Strong understanding of data warehousing and database design
- Hands-on experience with Apache Spark / PySpark
- Knowledge of Docker and Kubernetes
- Exposure to CI/CD pipelines
- Experience with monitoring and logging tools
- Familiarity with version control tools like Git
Soft Skills:
- Strong analytical and critical thinking skills
- Good communication and stakeholder management
- Ability to work with cross-functional teams
- Self-driven and proactive mindset
Click on Apply to know more.