About the Internship
We are looking for a backend developer with hands-on experience integrating open-source LLMs (e.g., Mistral, LLaMA) and vector databases (like FAISS, Qdrant, Weaviate, Milvus) in offline or edge environments.You will help develop core APIs and infrastructure to support embedding pipelines, retrieval-augmented generation (RAG), and LLM inference on local or mobile hardware.
Selected intern's day-to-day responsibilities include:
- Design and implement backend services that interface with local LLMs and vector databases
- Develop APIs to support prompt engineering, retrieval, and inference
- Integrate embedding models (e.g., BGE, MiniLM) and manage chunking/processing pipelines
- Optimize performance for offline or constrained environments (mobile, embedded devices, etc.)
- Package and deploy models via frameworks like Ollama, llama.cpp, gguf, or on-device runtimes
- Handle local file I/O, document ingestion, metadata tagging, and indexing
Number of Openings
3 openingsPerks of this Internship
Certificate Flexible work hours
Other Requirements
1. are available for the part time job/internship
2. have relevant skills and interests
3. can start the part time job/internship between 24th Jul'25 and 28th Aug'25
4. are available for duration of 5 months
5. have already graduated or are currently in any year of study
Similar Internship Programs
International Business Development work from home job/internship at Pooja Bharti
Pooja Bharti
Stipend
INR 5000 - 10000 /month
Apply By
07 August, 2025
Duration
6 months
Working
Part time
Business Development (Sales) work from home job/internship at Source Spark Tech
Brijesh Panchal
Stipend
INR 10000 - 14000 /month
Apply By
10 August, 2025
Duration
3 months
Working
Part time
Video Editing/Making work from home job/internship at Influnexus
Influnexus
Stipend
INR 6000 /month
Apply By
14 August, 2025
Duration
6 months
Working
full time
Unity Developer - Remote work from home job/internship at Piyush
Piyush Garg
Stipend
INR 5000 - 20000 /month
Apply By
14 August, 2025
Duration
2 months
Working
Part time
