ImpactoDigifin
Website:
impactodigifin.com
Job details:
AI/ML Engineer (Open-Source LLM – BFSI Domain)
Job Title: AI/ML Engineer (Open-Source LLM – BFSI Domain)
Location: Brookefield, Bengaluru
Employment Type: Full-Time
Work Schedule: Monday to Saturday (Alternate Saturdays Off)
Working Hours: 9:00 AM – 6:00 PM (Extendable based on project requirements)
About The Role
We are seeking a talented AI/ML Engineer with hands-on experience in building, fine-tuning, and deploying Open-Source Large Language Models (LLMs) for the Banking, Financial Services, and Insurance (BFSI) domain. The ideal candidate will have practical experience developing production-ready AI solutions and a passion for leveraging Generative AI to solve real-world business challenges.
In this role, you will collaborate with Product, Engineering, and Data Science teams to design intelligent AI solutions that enhance customer experience, automate business processes, and improve operational efficiency.
Key Responsibilities
Design, develop, fine-tune, and deploy Open-Source LLMs for BFSI use cases.
Build AI-powered applications using modern LLM frameworks and orchestration tools.
Collaborate with Product Managers, Data Scientists, and Software Engineers to understand business requirements and deliver scalable AI solutions.
Conduct model experimentation, evaluation, optimization, and performance benchmarking using real-world datasets.
Implement Retrieval-Augmented Generation (RAG), prompt engineering, vector databases, and AI workflows where applicable.
Monitor model performance in production environments and continuously improve model accuracy, latency, and scalability.
Ensure AI solutions comply with enterprise security, privacy, and regulatory standards.
Develop APIs and integrate AI models into enterprise applications.
Maintain technical documentation, architecture diagrams, and deployment procedures.
Stay updated with the latest advancements in Artificial Intelligence, Machine Learning, and Open-Source LLM technologies.
Required Qualifications
Education
Bachelor's degree in Computer Science, Artificial Intelligence, Information Technology, Engineering, or a related technical field.
Equivalent practical experience will also be considered.
Experience
Minimum 2+ years of hands-on AI/ML development experience.
Experience In The BFSI Domain Is Preferred.
Proven experience building and deploying AI/ML solutions in production environments.
Technical Skills
Programming Languages
Python (Mandatory)
Java (Preferred)
AI/ML Frameworks
PyTorch
TensorFlow
Scikit-learn
Open-Source LLM Technologies
Experience With One Or More Of The Following
LangChain
LangGraph
Ollama
Hugging Face Transformers
Llama
Mistral
DeepSeek
Qwen
vLLM
FastAPI
Generative AI
Prompt Engineering
Fine-Tuning LLMs
Retrieval-Augmented Generation (RAG)
Embeddings
Vector Databases (FAISS, ChromaDB, Milvus, Pinecone, etc.)
Model Evaluation and Optimization
Additional Skills
Docker
Kubernetes (Preferred)
REST APIs
Git
Linux
CI/CD pipelines
Core Competencies
Strong analytical and problem-solving skills.
Excellent understanding of AI/ML concepts and LLM architectures.
Ability to communicate technical concepts to non-technical stakeholders.
Strong interpersonal and collaboration skills.
Self-motivated with a passion for continuous learning and innovation.
Preferred Experience
Experience in any of the following areas will be an added advantage:
Banking & Financial Services applications
Fraud Detection
Credit Risk Assessment
Intelligent Document Processing
Loan Processing Automation
Customer Support Chatbots
Regulatory Compliance
OCR & Document AI
Agentic AI and Multi-Agent Systems
Interview Process
Round 1 – Technical Interview
Conducted by: Senior AI Engineer
Assessment Includes
Python Programming
Machine Learning Fundamentals
Open-Source LLMs
LangChain & RAG
Coding and Problem Sol…
Skills:- Python, Huggingface, Stackless Python, Retrieval Augmented Generation (RAG), Open-source LLMs, Prompt engineering, Stani's Python Editor and prometheus
Click on Apply to know more.