Website:
yminds.ai
Job details:
About the Role
Our client is seeking a highly experienced Senior Data Engineer to join their Data Platform team in Chennai. This role focuses on designing, building, and optimizing large-scale data infrastructure and pipelines. The ideal candidate will work across the full data lifecycle, enabling seamless data integration, high-performance processing, and advanced analytics to support business-critical applications.
Key Responsibilities
- Design, deploy, configure, and manage multi-node big data clusters
- Build and maintain scalable data pipelines and data lake architectures
- Automate infrastructure operations using scripts (Shell/Python)
- Develop BI solutions, dashboards, and KPIs for business insights
- Design and maintain data models for reporting and analytics
- Optimize platform performance, troubleshoot issues, and ensure reliability
- Support developers and business users with infrastructure and data needs
- Work with cross-functional teams for software deployment and data solutions
- Build automated solutions for reporting and deep data analysis
- Continuously adopt new technologies to solve business problems
Required Skills
- 5+ years of experience in Data Engineering / Big Data environments
- Strong expertise in Data Lake technologies (Spark, Hadoop, Yarn, Distributed File Systems)
- Experience with Cloud Platforms (GCP / AWS)
- Strong SQL experience (Vertica, Dremio, or similar big data SQL tools)
- Proficiency in Python and Shell scripting
- Experience with ETL pipelines and OLAP systems
- Strong debugging, monitoring, and troubleshooting skills
- Familiarity with version control and relational databases
- Experience working in Linux-based environments
- Bachelor’s/Master’s degree in Computer Science or related field
Nice-to-Have Skills
- Experience with Visualization tools (Apache Superset, Tableau)
- Exposure to AWS EMR and advanced cloud services
- Strong understanding of data structures and analytics workflows
- Experience working in Agile environments
- Good communication and system design skills
- Experience with on-call support and production environments
About YMinds.AI
YMinds.AI is a talent and consulting partner connecting top-tier tech professionals with high-growth organizations. We specialize in building high-performing engineering teams by aligning the right talent with the right opportunities, ensuring long-term success for both clients and candidates.
Keywords
Senior Data Engineer, Big Data, Data Lake, Apache Spark, Hadoop, Yarn, GCP, AWS, SQL, Python, ETL, OLAP, Data Modeling, BI, Data Pipelines
Hashtags
#DataEngineering #SeniorDataEngineer #BigData #ApacheSpark #Hadoop #GCP #AWS #Python #SQL #Hiring #ChennaiJobs #TechJobs #DataJobs
Click on Apply to know more.