Tata Consultancy Services
Website:
tcs.com
Job details:
Job Title - Data Engineer with Pyspark
Location -Pune/ Indore
Experience- 5-8 Years
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using PySpark
- Process large volumes of structured and semi-structured data
- Optimize Spark jobs for performance, scalability, and reliability
- Develop batch and streaming data processing solutions
- Integrate data from databases, APIs, files, and event streams
- Collaborate with analytics and data science teams
- Prepare technical documentation and participate in code reviews
Required Skills & Qualifications
- Strong hands-on experience with PySpark
- Proficiency in Python programming
- Strong understanding of Apache Spark architecture
- Advanced SQL skills
- Experience with ETL / ELT frameworks
- Hands-on experience with big data technologies
Good to Have Skills
- Databricks platform experience
- Apache Kafka or other streaming technologies
- Airflow or similar workflow orchestration tools
- CI/CD pipelines for data engineering
- Knowledge of data modeling and data warehousing
- Exposure to cloud data platforms such as Snowflake
Click on Apply to know more.