Website:
nasugroup.com
Job details:
Location: Bangalore; Hyderabad
Experience: 5 years +
Employment Type: Full-time
Job Summary
We are seeking a highly skilled Big Data Engineer with strong expertise in Scala, along with solid experience in Java 8, Python (PySpark), and Hadoop architecture. The ideal candidate should possess advanced problem-solving abilities and a strong foundation in building scalable data processing systems.
Key Responsibilities
Design, develop, and optimize large-scale data processing pipelines using Scala.
Work with distributed systems and Hadoop ecosystem components to handle big data workloads.
Write efficient, reusable, and scalable code in Java 8 and Python (PySpark).
Apply advanced logic-building skills to solve complex data engineering problems.
Collaborate with cross-functional teams including data scientists, analysts, and product teams.
Ensure data quality, performance tuning, and reliability of data pipelines.
Participate in code reviews, testing, and deployment processes.
Required Skills
Strong hands-on experience with Apache Spark (Scala & PySpark)
Proficiency in Scala programming
Experience with Java 8 ( good to have )
Strong advanced logic-building and problem-solving skills
Expertise in Python (PySpark)
In-depth understanding of Hadoop Architecture and ecosystem (HDFS, YARN, MapReduce
Click on Apply to know more.