LLM Finetuning Expert
Mumbai, India · Full-time
- Posted 5d ago
- From LenDenClub’s careers page
- Location
- Mumbai, India
- Type
- Full-time
- Experience
- 3+ years
- Department
- Software Development
Apply on LenDenClub’s site
Opens the listing on lendenclub.keka.com
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
Key Responsibilities
- Select base models (Qwen, Llama, Gemma, Mistral, Indic models) and adapt tokenizers for Indic and code-mixed text.
- Curate training data from conversations, emails and financial documents, including synthetic data from larger teacher models.
- Run continued pretraining, SFT and LoRA/QLoRA or full fine-tuning for text and multimodal models.
- Align models with RLHF, reward modelling, DPO or GRPO, including verifiable rewards for numeric finance tasks.
- Train at scale on multi-GPU, multi-node setups using FSDP, DeepSpeed or Megatron with BF16/FP8.
- Design evaluations covering accuracy, numeric hallucination, bias and robustness; find weaknesses and fix them.
- Build scalable inference pipelines on vLLM, Triton Inference Server, SGLang or TensorRT-LLM, with quantisation for low-latency voice use.
- Work with product, data and business teams to turn their problems into model specs and success metrics.
Mandatory Skills
- 3+ years in deep learning with models shipped to production, including at least one model of 1B+ parameters you trained end to end on multiple GPUs.
- Hands-on with Hugging Face Transformers, PEFT and TRL, or equivalents such as Unsloth, Axolotl or torchtune.
- Post-training beyond SFT (RLHF, reward modelling, DPO, GRPO or similar), with measured gains on held-out data.
- Production inference experience on vLLM, Triton Inference Server or a similar engine.
- Clear written and verbal communication: you can turn training results into a one-page recommendation a business leader can act on.
Preferred Skills
- Debugging distributed training: divergence, NaN loss, OOM, low GPU utilisation, failed resume.
- Building evaluation sets and analysing model weaknesses such as bias and robustness.
- Hindi, Hinglish or other Indic language modelling.
- Financial data: bank statements, bureau reports, credit or collections conversations.
- Knowledge distillation, quantisation and inference optimisation.
- Speech or speech-to-speech models.
- Open-source contributions or published checkpoints.
- Experience working with business or customer-facing teams.
Skills they ask for
Pick one to see other roles that ask for it.
About LenDenClub
Peer-to-peer lending in IndiaLenDenClub operates an RBI-registered peer-to-peer lending platform in India.
See all 12 roles at LenDenClubMore roles at LenDenClub
See all 12- Operations ExecutiveMumbaiBusiness OperationsMumbai, India22h
- Credit Risk ManagerIndiaFinance and AccountingIndia3d
- SEO/ASO ManagerMumbaiMarketingMumbai, India4d
- Fraud Analytics ExpertMumbaiData and AnalyticsMumbai, India1w
Share this role
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.