IndiTech Consulting
Website:
inditech.ca
Company:
https://www.linkedin.com/company/inditech-consulting
Seniority: Mid-Senior level
Industries: IT Services and IT Consulting
Job details:
About the role
We are looking for an experienced Senior Data Engineer to join our team on a part-time, fully remote freelance engagement.
The ideal candidate should have strong hands-on experience building and optimizing large-scale data processing solutions using PySpark, AWS, Java, and SQL, along with exposure to AI/ML and modern data lake technologies such as Apache Hudi / Apache Iceberg.
🔹 Key Responsibilities
- Design, develop, and optimize scalable data engineering pipelines using PySpark.
- Work with AWS data and cloud services to build reliable data solutions.
- Develop and maintain data-processing applications using Java and Python.
- Write complex and optimized SQL queries for large datasets.
- Work with large-scale distributed data processing and data transformation.
- Implement and manage data lake architectures using Apache Hudi / Apache Iceberg.
- Support data ingestion, transformation, validation, and integration processes.
- Collaborate with AI/ML teams and support data pipelines required for machine learning use cases.
- Troubleshoot performance, data-quality, and pipeline-related issues.
- Contribute to production-grade, scalable, and maintainable data platforms.
🔹 Required Skills
- Experience in Data Engineering / Big Data Engineering.
- Strong hands-on experience with PySpark.
- Strong experience with AWS.
- Strong programming experience in Java and/or Python.
- Strong SQL skills.
- Experience working with large-scale distributed data processing.
- Experience with Apache Hudi and/or Apache Iceberg.
- Understanding of AI/ML data pipelines and use cases.
- Strong problem-solving and debugging skills.
🔹 Engagement
Employment Type: Part-Time / Freelance
Work Mode: 100% Remote
Experience: 6+ Years
Click on Apply to know more.