zorba ai
Website:
zorbaconsulting.in
Job details:
We are looking for an experienced
Data Engineering & AI professional with strong expertise in building scalable, cloud-based data platforms and integrating AI/Generative AI capabilities into enterprise data solutions.
The ideal candidate should have hands-on experience in Python, SQL, Spark/PySpark, distributed data processing, and end-to-end data pipeline development, along with exposure to LLM integration, RAG architectures, and vector databases.
Candidates must have prior experience in the Banking, Financial Services, or Insurance domain.
Key Responsibilities
- Design, develop, and maintain scalable end-to-end data engineering pipelines.
- Build cloud-native data platforms supporting analytics, Machine Learning, and Generative AI applications.
- Develop data ingestion, transformation, processing, and integration solutions using Python, SQL, Spark, and PySpark.
- Design and implement distributed data processing frameworks and modern Lakehouse architectures.
- Integrate enterprise data with Large Language Models (LLMs) and build Retrieval-Augmented Generation (RAG) solutions.
- Work with vector databases to support AI-powered search and intelligent applications.
- Leverage cloud platforms such as AWS, Azure, or GCP and data platforms such as Databricks or Snowflake.
- Implement data quality, governance, security, monitoring, and performance optimization.
- Collaborate with Data Scientists, AI Engineers, and Solution Architects to deliver production-ready AI-enabled data solutions.
- Support platform modernization, CI/CD, orchestration, and deployment activities.
Mandatory Technical Skills
- Programming: Strong hands-on experience in Python and SQL.
- Big Data Technologies: Apache Spark / PySpark and distributed data processing.
- Data Engineering: End-to-end ETL/ELT pipelines, data ingestion, transformation, and integration.
- Cloud Technologies: AWS / Azure / GCP.
- Data Platforms: Databricks / Snowflake.
- AI / Generative AI: LLM integration, RAG architecture, and vector databases.
- Data Architecture: Lakehouse architecture and scalable data platform design.
- Production Engineering: CI/CD, orchestration, monitoring, data governance, and security.
BFSI Domain Experience – Mandatory
Candidates must have hands-on experience working in the Banking, Financial Services, or Insurance domain.
Relevant Experience Includes
- Banking and customer/account data.
- Financial transactions and payment processing.
- Risk management and credit analytics.
- Fraud detection and compliance.
- Financial reporting and regulatory data.
- Insurance and claims data.
Preferred Candidate Profiles
- Senior Data Engineer
- Lead Data Engineer
- Data Platform Engineer
- Data Engineering Architect
- AI Data Engineer
- AI Platform Engineer
Ideal Candidate
A hands-on Data Engineering professional with strong Python, SQL, and Spark/PySpark expertise, experience developing enterprise-scale data pipelines, and practical exposure to GenAI technologies such as LLMs, RAG, and vector databases.
The candidate must have BFSI domain experience and the ability to build secure, scalable, production-ready data platforms that enable enterprise AI applications.
Important Screening Criteria
- 6–10 years of overall experience.
- BFSI / Banking / Financial Services experience is mandatory.
- Strong hands-on Python, SQL, and Spark/PySpark.
- Experience developing end-to-end data pipelines.
- Practical exposure to LLM integration, RAG, or vector databases.
- Cloud experience in AWS / Azure / GCP.
- Immediate to 30 days' notice period.
- Comfortable working from office 4 days per week.
Skills: llm,aws,sql,azure,gcp,ci/cd,bfsi,python,gen ai
Click on Apply to know more.