Website:
Job details:
Job Title: Data Engineer
Job Type: Full Time
Location: Pune, India
Experience: 4–8 Years
Job Summary
We are looking for an experienced
Data Engineer with strong expertise in big data technologies, data pipelines, distributed processing, and data modeling.
The ideal candidate should have a minimum of
4 years of hands-on experience with core technologies and possess excellent communication skills.
Must-Have Skills
Category Skills / Experience
Programming Languages Python (PySpark), SQL, Java
Big Data Frameworks Apache Spark
Workflow Orchestration Apache Airflow
Streaming & Messaging Apache Kafka
Operating System Strong familiarity with Linux/Unix environments and shell scripting
Data Engineering Experience in data ingestion, ETL/ELT pipeline development, data transformation, data cleansing, and data quality validation
Data Modelling Experience in logical and physical data modeling, schema design, and data warehouse concepts
Good-to-Have Skills
Category Skills / Experience
API Integration Experience developing or consuming RESTful APIs
Stream Processing Experience with Apache Flink or other real-time stream processing frameworks
Key Requirements
- Minimum 4 years of relevant experience in Data Engineering.
- Strong hands-on experience with Python (PySpark), SQL, and Java.
- Strong knowledge of Apache Spark, Apache Airflow, and Apache Kafka.
- Good understanding of Linux/Unix environments and shell scripting.
- Experience building and managing data ingestion and ETL/ELT pipelines.
- Strong understanding of data transformation, cleansing, and data quality validation.
- Experience with logical and physical data modeling.
- Understanding of schema design and data warehouse concepts.
- Excellent communication and stakeholder-management skills.
- Experience with REST APIs and Apache Flink/real-time stream processing will be an advantage.
Benefits & Perks
[Add information regarding benefits and perks here]
Skills: apache spark,apache,pyspark,java,apache kafka,sql,airflow
Click on Apply to know more.
