eInfochips (An Arrow Company)
Website:
einfochips.com
Job details:
Role: Data/DB Engineer Lead (AWS / 9+ years of experience)
Location: Ahmedabad, Pune
Years of Experience: 9 to 15 yrs
Notice: Looking for 0-30 Days Joiner
Introduction
Our team builds a data platform that reliably collects, processes, and retrieves large-scale IoT data based on AWS. We are seeking Lead/Senior engineer who can design unobstructed flow even among billions of data records, push data storage performance to the limit, and technically lead service growth.
Key Responsibilities
- High-availability data pipeline design: AWS MSK (Kafka), end-to-end data streaming architecture design and operation using Logstash
- Storage optimization and sharding strategies: Optimizing large-scale search performance through OpenSearch's index design, sharding, and lifecycle (ISM) management
- Data Modeling and Partitioning: Table partitioning and data modeling in PostgreSQL/MySQL, architecture guide for efficient querying
- Performance Tuning and Guidance: Leading SQL optimization across services and spreading technical best practices to backend development teams
- Release Management: Be the gatekeeper during key database / data pipeline release activities, create review checklist, review deployment details and validates details before deployment to ensure zero-error deployments without roll back needs.
- Infrastructure automation: DB schema versioning (such as Flyway) and deployment process automation systems
Requirements
- Over 7 years of experience in data engineering or related backend development
- Extensive experience in operating infrastructure handling large-scale traffic in AWS cloud environments
- Strong capabilities in building real-time data pipelines and troubleshooting using Kafka
- Experience in OpenSearch (Elasticsearch) cluster design and sharding optimization is essential.
- Deep understanding of the internal structure of RDBMS (PostgreSQL/MySQL) and ability to tune complex queries
Preferred Qualifications
- Seamless technical collaboration capabilities: Communication skills to discuss infrastructure optimization with DevOps engineers and provide efficient data modeling and query guides to backend developers
- Global collaboration skills: Able to share technical documents with engineers across the globe and conduct work via video conferences during collaborative work sessions
- IoT Domain Experience: Experience in handling large-scale device messages and building data pipelines
- Ensuring data stability: Experience in designing logic to prevent data loss during failures and ensure consistency verification
- Nice to have è IaC Proficiency: Nice to have Experience coding and automated operations of data infrastructure using Terraform, Ansible, and others
- 4 years of bachelor’s degree or higher in Computer Science or equivalent discipline
What We Offer:
- Competitive Salary
- Work Life Balance
- Professional Development
- Innovative Work Environment.
- Recognition and Rewards
Click on Apply to know more.
