vadi2

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

llama.cpp

LLM inference in C/C++

llama

Inference code for LLaMA models

text-generation-webui

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

GPTs

leaked prompts of GPTs

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

localGPT

Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

tabby

Self-hosted AI coding assistant

mlflow

Open source platform for the machine learning lifecycle

h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/

open-llms

📋 A list of open LLMs available for commercial use.

faster-whisper

Faster Whisper transcription with CTranslate2

OpenLLM

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

text-generation-inference

Large Language Model Text Generation Inference

llama-recipes

Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger

llama-cpp-python

Python bindings for llama.cpp

koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

pgroll

PostgreSQL zero-downtime migrations made easy

whisper_streaming

Whisper realtime streaming for long speech-to-text transcription and translation

hallucination-leaderboard

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

jekyll-serif-theme

Serif is a multi page business theme for Jekyll.

are-copilots-local-yet

Are Copilots Local Yet? The frontier of local LLM Copilots for code completion, project generation, shell assistance, and more. Find tools shaping tomorrow's developer experience, today!

exui

Web UI for ExLlamaV2

velopack

Installer and automatic update framework for cross-platform desktop applications

EBiCS_Firmware

Free FOC firmware for Lishui E-Bike-Controllers

llm-humaneval-benchmarks

fhirpath-py

FHIRPath implementation in Python.

openai-summary

Summarize URL's or files (including YouTube videos via transcripts) using an OpenAI compatible API.

Hl7.Fhir.FhirPath.Validator