Job Description
We are looking for an experienced Resident Solution Architect (RSA) – Data & Databricks with strong expertise in Databricks, Data Engineering, PySpark, Python, SQL and Cloud.
The candidate will work closely with enterprise customers to understand business and technical requirements, design scalable data solutions, lead architecture discussions and POCs, and provide technical guidance to engineering teams.
Key Responsibilities
- Design end-to-end Data, Analytics and Lakehouse solutions using Databricks.
- Work hands-on with Databricks, Apache Spark, PySpark, Python and SQL.
- Design and review scalable ETL/ELT data pipelines and data platforms.
- Work with Delta Lake, Unity Catalog, Databricks SQL and Databricks Workflows.
- Design solutions on Azure / AWS / GCP cloud platforms.
- Conduct technical discovery, architecture workshops and solution discussions with customers.
- Prepare HLD/LLD, architecture diagrams and technical documentation.
- Lead POCs, technical demonstrations and solution validations.
- Provide technical guidance and mentorship to Data Engineering teams.
- Troubleshoot and optimize Databricks/Spark workloads for performance, scalability and cost.
- Support data modernization and migration initiatives.
- Collaborate with Sales, Pre-Sales, Delivery and Engineering teams on solutioning.
- Interact with senior customer stakeholders including Architects, Engineering Managers, CTOs/CDOs and technology leaders.
Required Skills
- 8+ years of experience in Data Engineering / Data Architecture / Solution Architecture / Big Data.
- Strong hands-on experience in Databricks.
- Strong knowledge of PySpark / Apache Spark.
- Strong programming experience in Python and SQL.
- Experience with Delta Lake, Unity Catalog and Lakehouse Architecture.
- Strong understanding of ETL/ELT, data modelling and data warehousing.
- Experience with Azure, AWS or GCP.
- Experience in performance tuning and optimization.
- Strong customer-facing, consulting and communication skills.
- Experience in technical solution design, POCs and architecture discussions.
Good to Have
Databricks Certification, Snowflake, Kafka, Spark Streaming, dbt, Terraform, CI/CD, MLflow, MLOps, GenAI/LLM/RAG and Data Migration experience.
