喵哩个咪's starred repositories
LowMemoryBP
The official implementation of the paper "Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation"
TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
ComfyUI-GGUF
GGUF Quantization support for native ComfyUI models
jsonformer
A Bulletproof Way to Generate Structured JSON from Language Models
ollama-copilot
Proxy that allows you to use ollama as a copilot like Github copilot
flash-attention
Fast and memory-efficient exact attention
flash-attention-2-builds
(Unofficial) Manual builds of wheels for https://github.com/Dao-AILab/flash-attention for Windows x64
SimpleTuner
A general fine-tuning kit geared toward diffusion models.
SqueezeLLM
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
torch-bnb-fp4
Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops
optimum-quanto
A pytorch quantization backend for optimum
ComfyUI-AutomaticCFG
If your image was a pizza and the CFG the temperature of your oven: this is a thermostat that ensures it is always cooked like you want. Also adds a 30% speed increase. For ComfyUI / StableDiffusion