Data Engineer
Salary
₹4 - 14 LPA
Min Experience
4 years
Location
Hyderabad
JobType
full-time
- Overview
About the role
Requirements:
- 4+ years experience in data engineering
- Strong proficiency in Python and SQL
- Hands-on experience with Apache Hudi
- Expertise in Apache workflow tools such as Apache Airflow or Apache NiFi for data pipeline orchestration and data ingestion
- Familiarity with big data technologies (e.g., Spark, Hadoop)
- Knowledge of cloud platforms (AWS, GCP, or Azure)
- Experience designing and implementing ETL/ELT processes
- Solid understanding of dimensional modeling concepts, including star schemas and snowflake schemas
- Ability to design and implement fact and dimension tables
- Experience with data warehouse design and optimization
- Excellent problem-solving and communication skills
Preferred Qualifications:
- Experience with data streaming technologies (Kafka, Flink)
- Familiarity with data governance and security practices
- Knowledge of real-time data processing and change data capture (CDC) techniques
- Experience with Apache Kafka for data ingestion and stream processing
- Contributions to open-source projects
Skills
Hadoop, Python