Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
Inference Llama 2 in one file of pure C
Ongoing research training transformer models at scale
OccNet: Scene as Occupancy
My first startup, LLMs for enterprise
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
Self-hosted AI coding assistant
Large Language Model Text Generation Inference
A high-throughput and memory-efficient inference and serving engine for LLMs