NarrowLabs Technologies Private Limited
Website:
narrowlabs.in
Job details:
Role: Big Data Engineer
Exp: 4 - 8 Years
Mode of Work: On-site
Employment Type: Full-time
CTC: 25LPA (If the candidate is a good fit, we are open to negotiating the CTC with the client.)
Location: Kochi
Important: Hands-on experience in designing, building, and tuning scalable big data processing
pipelines, including data ingestion, transformation, and workflow orchestration. Strong expertise in
big data architectures, cloud-based data solutions, and end-to-end pipeline design and
documentation. Proficient in Python, Java, and Scala, with extensive experience using big data
frameworks such as Apache Hadoop, Spark, Kafka, and Flink for batch and real-time data processing
1) They are specifically looking for candidates from Kerala and Tamil Nadu; candidates from
other states need not be considered
2) The rejection rate is high as they are specifically looking for highly experienced candidates
with a strong service background.
Job Description
Design, develop, and maintain scalable and efficient big data processingpipelines
distributed computing systems
Collaborate with cross-functional teams to understand data requirements anddesign ap
propriate data solutions.
Implement data ingestion, processing, and transformation processes tosupport v
arious analytical and machine learning use cases.
Optimize and tune data pipelines for performance, scalability, and reliability.
Monitor and troubleshoot pipeline performance issues, identifying andresolving
bottlenecks.
Ensure data quality and integrity throughout the pipeline,implement
ing data validation and error handling mechanisms.
Stay updated on emerging technologies and best practicesin big da
ta processing and analytics, incorporating them into our data engineeringpracti</s
trong>ces.
Document design decisions, technical specifications, and data workflows.Mandatory
Qualification:
Bachelor's degree in computer science, Engineering, or related field. Master'sdegree pr
eferred.
Proven experience (3+ years) as a Data Engineer or similar role, with a focuson big da
ta processing.
Strong proficiency in programming languages such as Python, Java, & Scala.
Experience with big data processing frameworks and technologies such asApache Ha
doop, Spark, Kafka, Flink, etc.
Hands-on experience with distributed computing, parallel processing, andcloud-bas
ed data platforms (e.g., AWS, Azure, Google Cloud).
Proficiency in SQL and database technologies (e.g., SQL Server,PostgreSQ
L, MySQL).
Experience with data warehousing, ETL (Extract, Transform, Load)processes
, and data modeling.
Familiarity with containerization technologies (e.g., Docker, Kubernetes) andDevOps pr
actices.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills, with the ability to workeffective
ly in a team environment.Tools and
Technologies:
IDEs: IntelliJ IDEA, Eclipse
Build Tools: Maven, Gradle
Testing Frameworks: JUnit, Mockito, TestNG
Containerization: Docker, Kubernetes
API Documentation: Swagger, OpenAPI
Monitoring and Logging: Prometheus, Grafana, ELK Stack
Database: MySQL, PostgreSQL, MongoDB, Redis
ORM Frameworks: Hibernate, Spring Data
Message Brokers: Kafk
Click on Apply to know more.