AWS Databrick Consultant

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world. JOb Description Must have Primary Skill : Databricks Platform Administration • Deploy, configure, and maintain AWS Databricks workspaces • Manage clusters, pools, and jobs for optimal performance. • Handle Databricks Runtime upgrades and compatibility testing. • Configure Databricks notebooks, Repos, and Delta Lake for efficient workflows. Security & Access Control: • Implement Identity and Access Management (IAM) using Azure AD / Azure IAM / SCIM. • Set up and enforce Role-Based Access Control (RBAC) and network security. • Ensure compliance with data governance policies (Unity Catalog, creation of Catalogs, schema etc.). • Applying grants of catalogs and schemas • Manage personal access tokens (PATs) and OAuth-based authentication. Performance Monitoring & Optimization: • Monitor cluster performance, auto-scaling, and cost optimization. • Analyze and fine-tune Spark jobs to improve execution efficiency. • Use Databricks SQL for querying and performance diagnostics. Integration & Automation: • Integrate Databricks with Snowflake, Teradata, Oracle and other data sources. • Automate cluster management using Terraform. • Implement CI/CD pipelines for Databricks notebooks using GitHub. Troubleshooting & Support: • Investigate and resolve job failures, cluster crashes, and query performance issues. • Provide L2/L3 support for Databricks infrastructure issues. • Collaborate with Databricks support for bug fixes and escalations.

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.