Staff Engineer - Java,Scala,Python
Experian
- Location
- Hyderabad, Telangana, India
- Job type
- Full-time
Required skills
- Python
- Agile
- AWS
- Apache
- big data technologies
- Cassandra
- CSV
- DevOps
- ECS
- enterprise software
- Hadoop
- Java
- Kafka
- micro-services
- middleware
- MySQL
- Parquet
- Spark
About the role
Experian
Website:
experianplc.com
Job details:
Job Description
- Design, develop and implement the Kafka ecosystem by creating a framework for using technologies such as Kafka Connect, KStreams/KSQL, Attunity, Schema Registry, and other streaming-oriented technology
- Help build the DevOps strategy for hosting and managing our SDP microservice and connector infrastructure in AWS cloud
- Experience with design/implementing big data technologies around Apache Hadoop, Kafka streaming, No SQL, Java/J2EE and distributed computing platforms in large enterprises where scale and complexity have been tackled.
- Experience participating in Agile development projects for enterprise-level systems component design and implementation
- Understand and application of enterprise software design for implementation of data services and middleware.
- You will be reporting to a Senior Manager of Engineering
Qualifications
- Bachelor's degree in technical discipline; Masters preferred
- We require you to have 7+ years hands-on with good coding skills with Java, Scala, Python.
- Experience with Kafka Streaming, Containerized Micro-services
- Experience monitoring the health of Kafka group (data loss and data lagging) and strategy for short TTD (time to detect) of broker failure and fast TTR (time to recover)
- Experience with RDBMS (Aurora MySQL) and No-SQL (Cassandra)
- AWS Cloud experience – S3, EFS, MSK, ECS, EMR, etc.
- Knowledge of Hadoop/Spark and multiple data formats like Parquet, CSV, etc. is a plus
Click on Apply to know more.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.