Sourab Mangrulkar's repositories
LLM-Workshop
LLM Workshop by Sourab Mangrulkar
openhathi_instruct
This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resulting model is meant to follow instructions and chat in Hindi and Hinglish.
acm_winter_school_gen_ai
Code for the hands-on projects for the students attending the ACM India Winter School 2023
devika
Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective. Devika aims to be a competitive open-source alternative to Devin by Cognition AI.
accelerate
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
llama-recipes
Examples and recipes for Llama 2 model
peft-dreambooth-ui
An UI for Dreambooth training and inference using PEFT - Minimal, Easy to use and Adaptable.
bitsandbytes
8-bit CUDA functions for PyTorch
chat-ui
Open source codebase powering the HuggingChat app
hf_fsdp
A very basic fsdp wrapper for HF.
huggingface-vscode
Code completion VSCode extension for OSS models
llama-mistral
Inference code for Mistral and Mixtral hacked up into original Llama implementation
llama.cpp
LLM inference in C/C++
llama2.c
Inference Llama 2 in one file of pure C
llm.c
LLM training in simple, raw C/CUDA
minbpe
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
trl
Train transformer language models with reinforcement learning.