joebo

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

babyagi

recommenders

Best Practices on Recommendation Systems

guidance

A guidance language for controlling large language models.

neon

Neon: Serverless Postgres. We separated storage and compute to offer autoscaling, code-like database branching, and scale to zero.

gorilla

Gorilla: An API store for LLMs

open-llms

📋 A list of open LLMs available for commercial use.

miller

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

txtai

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

openplayground

An LLM playground you can run on your laptop

CTranslate2

Fast inference engine for Transformer models

EmbedAI

An app to interact privately with your documents using the power of GPT, 100% privately, no data leaks

exllama

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

every-chatgpt-gui

Every front-end GUI client for ChatGPT

saltcorn

Free and open source no-code application builder

pytorch-widedeep

A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch

Llama-2-Open-Source-LLM-CPU-Inference

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

Local-LLM-Comparison-Colab-UI

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

mpt-30B-inference

Run inference on MPT-30B using CPU

starcoder.cpp

C++ implementation for 💫StarCoder

cformers

SoTA Transformers with C-backend for fast inference on your CPU.

qv

Quickly view your data

TabularBenchmarks

llama_farm

Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.

gpt_chatwithPDF

GPT chat with your docs!

OgbujiPT

Client-side toolkit for using large language models, including where self-hosted

openai_text_generation_inference_server

Use OpenAI with HuggingChat by emulating the text_generation_inference_server

eigenGPT

Minimal C++ implementation of GPT2

MaxMiner

Optimized, CPU/GPU parallelizable implementation of Maximum Frequent Itemset Mining