MyCareernet
Company:
https://www.linkedin.com/company/mycareernet
Seniority: Director
Industries: Information Services
Job details:
Key Skills: Pyspark, AWS Cloud, Data architecture, Databricks, SQL, Python, GitHub, Terraform, Jenkins
Roles and Responsibilities:
- Lead the roadmap and architectural direction for scalable cloud-based data engineering solutions on AWS and Databricks.
- Design and implement data architecture aligned with enterprise standards, ensuring maintainability and operational readiness.
- Build and optimize data workflows using PySpark, Python, and SQL to support analytics and reporting use cases.
- Drive engineering execution with strong governance, including peer code reviews and release readiness for production pipelines.
- Leverage DevOps tooling and infrastructure automation to streamline delivery and reduce manual intervention.
Skills Required:
- 14 - 20 years of experience in application program development and data engineering.
- PySpark for large-scale data processing and analytics workloads.
- AWS Cloud hands-on experience for building and operating data services.
- Python and SQL for data engineering, transformation, and analytics enablement.
- Databricks for lakehouse development and production data pipeline delivery.
Good to Have:
- Jenkins for CI/CD automation.
- Terraform for infrastructure as code.
- GitHub for source control and collaboration.
Education: Bachelor's degree in Engineering, Computer Science, or related discipline.
Click on Apply to know more.
