Sr. Data Engineer
Insight Global
- Location
- Hyderabad, Telangana, India
- Job type
- Full-time
Required skills
- Python
- AWS
- Apache
- Apache Spark
- cross-functional
- Hadoop
- Java
- Kafka
- Spark
About the role
Insight Global
Website:
insightglobal.com
Job details:
Key Responsibilities
- Design and develop real-time data pipelines using Kafka, Spark, AWS Kinesis, and related technologies.
- Build and support scalable data processing solutions on AWS.
- Modernize legacy ingestion frameworks using cloud-native services.
- Develop and optimize large-scale distributed data processing systems.
- Troubleshoot and support production data platforms and streaming applications.
- Collaborate with cross-functional teams on enterprise data integration initiatives.
Required Skills & Experience
- 10+ years of experience in Data Engineering, Software Engineering, or related fields.
- Strong expertise in AWS Cloud Services and cloud-native architectures.
- Hands-on experience with Apache Spark (Scala & PySpark).
- Strong knowledge of the Hadoop Ecosystem and distributed computing.
- Experience with Kafka, streaming technologies, and real-time data pipelines.
- Experience with AWS Kinesis, Kinesis Firehose, Flume, or similar ingestion platforms.
- Strong programming skills in Python, Scala, and Java.
- Experience with Big Data, Enterprise Data Warehousing, and Distributed Systems.
Click on Apply to know more.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.