TekPillar®
Website:
tekpillar.com
Job details:
Job Role: Data Engineer
Experience: 5+ Years
Location: Pune & Hyderabad
We are looking for a strong hands-on Senior Data Engineer with solid experience in Snowflake, Apache Airflow, AWS, Python, and Advanced SQL.
The ideal candidate should have strong expertise in building and supporting end-to-end ELT/data pipelines and must possess hands-on experience in the Healthcare domain, particularly with healthcare datasets, claims processing, payer/provider data, HIPAA compliance, and PHI/PII handling.
Candidates should be confident in explaining real-time project experience, pipeline architecture, troubleshooting activities, and production support responsibilities.
Key Responsibilities
- Design, develop, and maintain scalable ELT/data pipelines using Snowflake
- Build and optimize data ingestion, transformation, and orchestration workflows
- Develop and maintain Apache Airflow DAGs for scheduling and pipeline automation
- Write efficient Python scripts for automation, validation, API integrations, and data processing
- Work with AWS services including S3, Lambda, SNS, CloudWatch, and IAM
- Develop advanced SQL queries, stored procedures, and data transformation logic
- Perform production support, troubleshooting, root-cause analysis, and pipeline monitoring
- Implement CI/CD workflows and support database migration activities
- Work with healthcare datasets including claims, payer, provider, and pricing data
- Ensure compliance with HIPAA, PHI/PII handling, and healthcare data governance standards
- Collaborate with cross-functional teams to understand business and technical requirements
- Maintain technical documentation and operational runbooks
Required Qualifications & Skills
- 5+ years of hands-on Data Engineering experience
- Strong expertise in Snowflake and ELT pipeline development
- Advanced SQL skills including joins, CTEs, window functions, query optimization, and dynamic SQL
- Strong Python programming experience
- Hands-on experience with Apache Airflow
- Experience with AWS services such as S3, Lambda, SNS, CloudWatch, and IAM
- Strong understanding of end-to-end data pipeline architecture and orchestration
- Experience in troubleshooting, production support, and pipeline optimization
- Hands-on experience in Healthcare domain projects
- Good understanding of PHI/PII handling and HIPAA compliance
- Experience working with claims, payer, provider, or healthcare-related datasets
Click on Apply to know more.