Recro
Website:
recro.io
Job details:
We’re Hiring: Databricks Data Architect
Are you passionate about building state-of-the-art data platforms and leading modern enterprise transformations? We are looking for an experienced Databricks Data Architect to lead the architecture, design, and optimization of our enterprise Databricks Lakehouse platform.
In this role, you will define target-state architectures, modernize legacy platforms, and build high-performance, secure, and governed data products at scale.
📍 Key Responsibilities
- Lakehouse Architecture: Design & implement enterprise-scale Databricks Lakehouse solutions leveraging Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Databricks SQL.
- Modernization & Migration: Lead migration and refactoring of legacy Synapse, SQL Server, Hadoop, and T-SQL workloads into PySpark, Databricks SQL, and Delta-based architectures.
- Data Modeling & Performance: Architect Medallion (Bronze/Silver/Gold) models and implement Liquid Clustering, Z-Ordering, partitioning, and cost optimization strategies.
- Real-time Ingestion: Build robust streaming and batch ingestion frameworks using Auto Loader, Structured Streaming, and Delta Change Data Feed (CDF).
- Governance & Security: Integrate enterprise security, data quality, lineage, and compliance via Unity Catalog.
- Automation & DataOps: Establish CI/CD pipelines, Infrastructure-as-Code (Terraform), and Databricks Asset Bundles (DAB).
💡 Key Qualifications
- Experience: 12+ years in Data Engineering/Architecture, with 5+ years specifically in Databricks architecture.
- Core Tech Stack: Databricks Lakehouse, PySpark, Spark SQL, Python, Delta Lake, Unity Catalog, DLT, and MLflow.
- Cloud Platform: Strong hands-on experience with Microsoft Azure (ADLS Gen2, ADF, Azure Entra ID, Event Hubs).
- Automation: Hands-on experience with Git, Terraform, Azure DevOps, and DABs.
- Domain: Banking and Financial Services (BFS) domain experience is highly preferred.
- Concepts: Deep understanding of Data Mesh principles, Data Products, and enterprise modernization.
Click on Apply to know more.