Senior Data Engineer
Peoplefy
- Location
- Pune City, Maharashtra, India
- Job type
- Full-time
Required skills
- Python
- Agile
- Azure
- data ingestion
- data lake
- data modeling
- data structures
- database
- Databricks
- ETL
- Git
- Informatica Intelligent Cloud Services
- SQL
- version control
About the role
Peoplefy
Website:
peoplefy.com
Job details:
- Senior Data Engineer- 9-12 years, Team Mentoring required
- Data Engineer- 6-9 years, IC role
Must have skills:
· Databricks
· Python/Pysaprk
· Development Side Experience
Required Qualification:
- Bachelor's degree in Computer Science, CIS, or related field and Minimum 8 years ofexperience in software development or a related field. Additional equivalent work experience may be substituted for the degree requirement
- 3 years in using Azure Data Factory for data ingestion, transformation, and orchestration.
- 3 years with the Azure ecosystem, including services like Azure Data Lake Storage, Azure Blob Storage, and Azure SQL Database
- 3 years of software development lifecycle, agile methodologies, CI/CD, and version control systems (e.g., Git).
- Understanding of data governance principles, data quality, and security best practices
- 3 years in designing and developing ETL processes using Informatica IICS. Experience with Informatica Intelligent Cloud Services, including its CAI (Cloud Application Integration) and CDI (Cloud Data Integration) modules.
- 3 years in Python in developing and debugging code, with a focus on data manipulation and processing.
- 3 years Hands-on experience with Databricks platform, including Delta Lake and Lakehouse architecture.
- 3 years of experience with data structures, data modeling, ETL/ELT concepts, and data warehousing principles.
- 3 years of experience with SQL skills for data querying and manipulation.
Click on Apply to know more.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.