Hamid Shojanazeri's repositories
HF-TP-inference
PyTorch Native Tensor Parallel for HuggingFace models inference
alpaca-lora
Instruct-tune LLaMA on consumer hardware
CS344_2021
Udacity CS344 Introduction to Parallell Programming (https://classroom.udacity.com/courses/cs344), with assignments/materials updated to build in 2021
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
fsdp_llm
FSDP optimizations for LLM training
LLaMA-Adapter
Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
llama-recipes-updates
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
Medusa
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
project_hera
decorate your room with your voice (generative AI)
resource-stream
CUDA related news and material links
stablediffusion2
High-Resolution Image Synthesis with Latent Diffusion Models
streaming-llm
Efficient Streaming Language Models with Attention Sinks
Tensor-Puzzles
Solve puzzles. Improve your pytorch.
ToolBench
An open platform for training, serving, and evaluating large language model for tool learning.
transformer_framework
framework for plug and play of various transformers (vision and nlp) with FSDP
transformers
🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
triton
Development repository for the Triton language and compiler
yarn
YaRN: Efficient Context Window Extension of Large Language Models