Techsophy

Sign Up/Sign In
Flag job

Report

Data Engineer

Salary

₹4 - 14 LPA

Min Experience

4 years

Location

Hyderabad

JobType

full-time

About the job

Info This job is sourced from a job board

About the role

Requirements:

  • 4+ years experience in data engineering
  • Strong proficiency in Python and SQL
  • Hands-on experience with Apache Hudi
  • Expertise in Apache workflow tools such as Apache Airflow or Apache NiFi for data pipeline orchestration and data ingestion
  • Familiarity with big data technologies (e.g., Spark, Hadoop)
  • Knowledge of cloud platforms (AWS, GCP, or Azure)
  • Experience designing and implementing ETL/ELT processes
  • Solid understanding of dimensional modeling concepts, including star schemas and snowflake schemas
  • Ability to design and implement fact and dimension tables
  • Experience with data warehouse design and optimization
  • Excellent problem-solving and communication skills

Preferred Qualifications:

  • Experience with data streaming technologies (Kafka, Flink)
  • Familiarity with data governance and security practices
  • Knowledge of real-time data processing and change data capture (CDC) techniques
  • Experience with Apache Kafka for data ingestion and stream processing
  • Contributions to open-source projects

Skills

Hadoop, Python