elyxlz's repositories
umap_pytorch
Pytorch port for Parametric Umap
cdcd-pytorch
A partial implementation of Continuous Diffusion for Categorical Data by Deepmind, in pytorch.
givt-pytorch
A partial implementation of Generative Infinite Vocabulary Transformer (GIVT) from Google Deepmind, in PyTorch.
neural-tokenizer
High compression text tokenizers via VQAEs for efficient and democratic language modeling.
paella-audio
a soundstorm / paella hybrid conditional encodec token predictor with discrete diffusion
ema-pytorch
A simple way to keep track of an Exponential Moving Average (EMA) version of your pytorch model
hourglass-llama
A clean, modern, and generalized implementation of causal hierarchical transformers.
lit-llama
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
sample-diffusion
A python library and CLI for generating audio samples using Harmonai Dance Diffusion models.
peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.