We are seeking a Senior Data Engineer to join our team in Hyderabad. In this role, you will own the end-to-end data pipeline including ingestion, enrichment, entity resolution, and data quality. You will work with advanced AI technologies such as large language models (LLMs) and embeddings as integral tools to solve complex data challenges that traditional methods cannot address.
Responsibilities:
- Design, build, and maintain scalable data pipelines and infrastructure.
- Manage data ingestion, enrichment, and entity resolution processes.
- Ensure data quality and reliability across systems.
- Optimize cost, performance, and architecture of AI and enrichment infrastructure.
- Leverage AI techniques including LLMs and embeddings to enhance data processing capabilities.
- Collaborate with cross-functional teams to deliver data solutions with direct customer impact.
Requirements:
- 5 to 8 years of experience in data engineering or related roles.
- Strong expertise in building and managing data pipelines and ETL processes.
- Experience with AI technologies, particularly LLMs and embeddings, is highly desirable.
- Ability to optimize data infrastructure for cost and performance.
- High ownership mindset with a focus on delivering quality data products.
- Excellent problem-solving skills and ability to work in a fast-paced environment.
Location: Hyderabad
Salary Range: 20 - 50 LPA