Sigerad

ComfyUI

The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.

LocalAI

:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

LLaMA-Factory

A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

generative-models

Generative Models by Stability AI

LLM-Fine-Tuning

ggml

Tensor library for machine learning

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

flash-attention

Fast and memory-efficient exact attention

mergekit

Tools for merging pretrained large language models.

exui

Web UI for ExLlamaV2

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

chatbot_clinic

Science-driven chatbot development

so-vits-svc

SoftVC VITS Singing Voice Conversion

AI-Horde-Worker

This repo turns your PC into a AI Horde worker node

AI-Horde

A crowdsourced distributed cluster for AI art and text generation

koboldcpp

A simple one-file way to run various GGML and GGUF models with a KoboldAI UI

koboldcpp-rocm

AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading

airoboros

Customizable implementation of the self-instruct paper.

HashingDeepLearning

Codebase for "SLIDE : In Defense of Smart Algorithms over Hardware Acceleration for Large-Scale Deep Learning Systems"

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios.

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

text-generation-webui-extensions

SillyTavern-Timelines

Timeline view for SillyTavern chats

SillyTavern-Extras

Extensions API for SillyTavern.

SillyTavern

LLM Frontend for Power Users.

KoboldAI

KoboldAI is generative AI software optimized for fictional use, but capable of much more!

aphrodite-engine

PygmalionAI's large-scale inference engine

EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

EasyLM

Easy to use model parallel large language models in JAX/Flax with pjit support on cloud TPU pods.