DataE2E Technologies
Website:
datae2e.com
Job details:
Job Title: Principal Architect - Databricks (Cencora)
Location: 100% Remot
Type: Full-time/Permanent
Position Overview
We are seeking a Principal Databricks Architect to serve as the chief technical authority for our next-generation Data & Analytics (D&A) ecosystem. In this role, you will bridge the gap between high-level business vision and gritty technical execution—defining our long-term Azure/Databricks roadmap while hands-on engineering solutions for our toughest scale, security, and integration challenges.
Key Responsibilities
- Architectural Governance & Roadmap: Own the technical evolution of our global Azure/Databricks landscape, establishing enterprise standards for data mesh architectures, security, and unified governance.
- R&D and Emerging Tech: Act as our primary innovation catalyst. Evaluate, benchmark, and productionize modern tooling—specifically integrating SODA for automated data quality pipelines and Astronomer (Airflow) for enterprise orchestration.
- Advanced Infrastructure Engineering: Solve complex, high-impact infrastructure hurdles including multi-tenant scaling, Databricks workspace segmentation, and cross-border global data residency compliance.
- Cloud FinOps & Efficiency: Establish cloud cost-governance models. Architect performance-tuning strategies (compute optimization, Serverless, Photon) to drastically reduce Databricks consumption spend without degrading SLAs.
- Modern Integration & CI/CD: Design real-time Change Data Capture (CDC) pipelines and modern deployment frameworks using Databricks Asset Bundles (DABs). Seamlessly connect core Warehouse Management Systems (MAWM, PKMS) with downstream AI analytics products like QEval.
Requirements
- Enterprise Leadership: 15+ years of data engineering and architecture experience, including 5+ years in a Principal, Lead, or Director capacity directing data strategy for large-scale enterprises.
- Databricks & Azure Expertise: Subject matter expertise in the Azure Data Stack and advanced Databricks capabilities (specifically Unity Catalog for fine-grained governance, Delta Live Tables, and Delta Lake optimization).
- Proven Execution: A clear history of taking disruptive R&D concepts or proof-of-concepts (POCs) and successfully hardening them into highly available, production-grade enterprise platforms.
- Ecosystem Familiarity: Experience integrating
Click on Apply to know more.