Intuition IT – Intuitive Technology Recruitment
Website:
intuition-it.com
Job details:
We are looking for an experienced Databricks Platform Administrator (L2 Ops Support) to manage, govern, and optimize enterprise Databricks environments. The role focuses on platform operations, security, cost optimization, governance, and reliability, ensuring secure and scalable analytics workloads across the organization.
The ideal candidate will have strong hands-on experience with Databricks administration, Unity Catalog, cloud integrations (AWS S3), security controls, cost management, and operational support, along with exposure to ServiceNow for incident, change, and problem management.
Key Responsibilities
- Design and administer catalogs, schemas, grants, and data lineage for compliant access and discovery.
- Integrate Unity Catalog with diverse sources and metastores
- Implement and maintain workspace, cluster, and UC-level permissions; groups, service principals, and SCIM provisioning.
- Define and enforce cluster and SQL warehouse policies; entitlement reviews and periodic access audits.
- Standardize installation and lifecycle of cluster/job-scoped libraries (PyPI/Maven/JAR/WHL).
- Manage init scripts, secret scopes, and package repositories for reproducible builds.
- Establish secure, governed integrations with cloud object storage (S3)
- Configure network/security controls (VPC/VNet), private links, firewall rules) and credentials/secrets rotation.
- Implement autoscaling, pools, spot/preemptible usage, and Photon acceleration where appropriate.
- Optimize SQL Warehouses, job scheduling, and cluster sizing; monitor and report spend with budgets/alerts.
- Evaluate and administer compute types (job clusters, interactive clusters, single-node, pools, SQL Warehouses, serverless) and their trade-offs.
- Enforce MFA and conditional access, and maintain SCIM/user lifecycle.
- Manage service principals, token policies, and audit/logging alignment with security standards.
- Lead Databricks runtime governance and migrations (e.g., DBR upgrades to LTS versions such as 14.3 LTS).
- Good Exposure to Service now
Click on Apply to know more.