Pinaca Technologies
Website:
pinacalabs.com
Job details:
Hiring Alert – Technical Lead (Big Data & Distributed Systems)
at Pinaca Technologies Private Limited
Location: Chennai
Experience: 8+ Years
Employment Type: Full-Time
Apply: reegan.p@pinacagroup.com
We are looking for a Technical Lead with strong expertise in Big Data systems, distributed computing, and on-premise deployments to lead the design and implementation of large-scale, data-intensive platforms.
The ideal candidate will have hands-on experience in data engineering, infrastructure optimization, system scalability, and enterprise-level deployment in on-prem environments. This role involves architecting end-to-end data pipelines, ensuring platform performance, optimizing compute and storage utilization, and leading a technical team that delivers reliable, secure, and high-performing systems.
Key Responsibilities:
• Architect, design, and lead the implementation of Big Data platforms capable of handling large-scale structured and unstructured data.
• Oversee on-prem deployment strategies, including compute resource management, load balancing, and storage optimization.
• Build and maintain data ingestion, transformation, and analytics pipelines using Apache Spark, Kafka, and Airflow.
• Ensure high availability, fault tolerance, and scalability across the data infrastructure.
• Lead system performance benchmarking, tuning, and capacity planning for on-prem clusters.
• Design data lake and data warehouse architectures for analytics and ML use cases.
• Collaborate with DevOps teams for CI/CD pipelines, monitoring, and automated deployment workflows.
• Ensure data security, compliance, and access control policies are enforced in on-prem environments.
• Work closely with Product, Data Science, and Infrastructure teams to align architecture with product goals.
• Lead and mentor a team of engineers to deliver high-quality, efficient, and maintainable codebases.
• Troubleshoot production issues, perform root cause analysis, and implement permanent fixes.
Requirements:
• 8+ years of experience in software or data engineering, with at least 2 years in a Technical Lead or Architect role.
• Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
• Strong expertise in Big Data technologies including Apache Spark, Kafka, and Airflow.
• Proficiency in Python, Go, or Java.
• Hands-on experience with HDFS, PostgreSQL, MySQL, MongoDB, Elasticsearch, and Redis.
• Experience in on-prem cluster management, Kubernetes, Docker, and infrastructure automation tools.
• Strong understanding of ETL pipelines, data warehousing, schema design, and partitioning.
Interested candidates can share their resumes to: reegan.p@pinacagroup.com
hashtag
#Hiring hashtag
#TechnicalLead hashtag
#BigData hashtag
#DataEngineering hashtag
#ApacheSpark hashtag
#Kafka hashtag
#Airflow hashtag
#DistributedSystems hashtag
#OnPremise hashtag
#DataPlatform hashtag
#MLOps hashtag
#Kubernetes hashtag
#Docker hashtag
#PythonJobs hashtag
#TechHiring hashtag
#ChennaiJobs hashtag
#ITJobs
hashtag
Click on Apply to know more.