CGI
Website:
cgi.com
Job details:
Position Description
Databricks Expert – Job description:
Role Summary
Databricks with strong data engineering skills and deep AWS cloud expertise.
To lead the design, build, and deployment of data products on the Databricks Lakehouse platform, ensuring scalability, governance, security, and business value delivery.
The role requires mastery in Databricks features, Delta Lake, AWS ecosystem integration, and modern Data Engineering best practices.
Primary Responsibilities
- Design, build, and manage data products and event driven architecture using Databricks Lakehouse principles.
- Design end-to-end data pipelines using PySpark, Databricks SQL.
- Define Data Product blueprint including domain boundaries, ownership, SLAs, documentation, quality rules.
- Implement modern ingestion frameworks using Auto Loader, Delta Live Tables, Workflows.
- Develop multi-zone medallion architecture (Bronze/Silver/Gold) using Delta Lake.
- Lead Databricks on AWS integration including S3 access, IAM roles, VPC networking.
- Implement Unity Catalog governance frameworks, fine-grained permissions, lineage tracking.
- Drive automation & DevOps practices using Git, Repos, Databricks CLI/SDK, CI/CD pipelines.
- Build and optimize Spark workloads for performance and cost control (Photon/Serverless tuning).
- Lead performance reviews, code quality checks, and data engineering guidance for teams.
- Operationalize Machine Learning and advanced analytics with MLflow/Feature Store/Model Serving.
- Monitor and enhance reliability using job monitoring, observability dashboards, alerts.
- Hands-on development of Power BI dashboards, DAX measures, data models, DirectQuery/Import mode
- Evaluate new Databricks features and adopt innovation into technical roadmap.
Technical Skills Required
- Strong programming experience in PySpark, SQL & Python for production-grade data pipelines.
- Deep mastery in Databricks, Delta Lake, Unity Catalog, Workflows, SQL Warehouses.
- Expert knowledge of AWS services: S3, Glue, Lambda, EMR, Step Functions, CloudWatch, VPC networking.
- Experience building data products with versioning, discoverability, contracts, metadata & lineage.
- Good understanding of Infra-as-Code: Terraform (workspace, clusters, UC policies, jobs, service principals).
- Strong foundation in data modeling, schema design, Lakehouse & Data Mesh principles.
- Familiar with governance & security frameworks (encryption, tokenization, row/column controls).
- Experience with enterprise integrations (Power BI).
Qualifications
- 5–10 years of professional Data Engineering experience.
- Minimum 3+ years hands-on with Databricks (production scale).
- Proven experience in delivering Data Products on cloud Lakehouse platforms.
Soft Skills
- Strong ownership mindset with Data Product thinking.
- Excellent communication and ability to translate architecture for business stakeholders.
- Ability to lead engineering teams and influence architecture decisions.
- Continuous innovation mindset with focus on automation, performance & reusability.
Skills Checklist for CV Screening:
Category Must Have Good to Have
Core Platform Databricks (3+ years) Model serving/Feature Store
Programming PySpark, SQL, Python
Architecture Data Product, Lakehouse, Medallion Data Mesh exposure
Databricks Features Delta Lake, Unity Catalog, Workflows, DLT, Repos Serverless SQL, Photon
Cloud Strong AWS (Lambda, S3, IAM, Glue, VPC) Cloud networking awareness
DevOps & IaC Git, CI/CD, Terraform Databricks CLI/SDK advanced
Data Pipelines Batch + Streaming
Optimization Spark tuning, partitioning, caching Cost governance
Security RBAC, token auth, encryption Data quality frameworks
Soft Skills Architecture thinking & leadership Client-facing
Your future duties and responsibilities
Required Qualifications To Be Successful In This Role
Together, as owners, let’s turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.
Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our team—one of the largest IT and business consulting services firms in the world.
Click on Apply to know more.