sbarman-mi9

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

llama-recipes

Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger

open_llama

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

SillyTavern

LLM Frontend for Power Users.

ChatLaw

ChatLaw：A Powerful LLM Tailored for Chinese Legal. 中文法律大模型

mamba

The Fast Cross-Platform Package Manager

layout-parser

A Unified Toolkit for Deep Learning Based Document Image Analysis

OpenPrompt

An Open-Source Framework for Prompt-Learning.

lollms-webui

Lord of Large Language Models Web User Interface

codeinterpreter-api

👾 Open source implementation of the ChatGPT Code Interpreter

autotrain-advanced

🤗 AutoTrain Advanced

inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

exllama

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

alibi-detect

Algorithms for outlier, adversarial and drift detection

news-please

news-please - an integrated web crawler and information extractor for news that just works

ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.

lanarky

The web framework for building LLM microservices

baal

Bayesian active learning library for research and industrial usecases.

mpt-30B-inference

Run inference on MPT-30B using CPU

datablations

Scaling Data-Constrained Language Models

codebox-api

📦 CodeBox is the simplest cloud infrastructure for your LLM Apps and Services.

dl-workshop

Crash course to master gradient-based machine learning. Also secretly a JAX course in disguise!

sseclient

Pure-Python Server Side Events (SSE) client

LangSynth

Conduct consumer interviews with synthetic focus groups using LLMs and LangChain

BasicC2

A basic no-Login Command & Control written in Python, works on Windows & Linux and has XOR encryption.

alphawave-py

AlphaWave is a very opinionated client for interfacing with Large Language Models.

llama-cpp-chat-completion-wrapper

Wrapper around llama-cpp-python for chat completion with LLaMA v2 models.

demo-vicuna-7b