TonyNemo

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

llama.cpp

LLM inference in C/C++

ollama

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

MiniCPM

MiniCPM-2B: An end-side LLM outperforming Llama2-13B.

LLMBox

A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

condor_tensorflow

CONditionals for Ordinal Regression and classification in tensorflow

nanotron

Minimalistic large language model 3D-parallelism training

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

alignment-handbook

Robust recipes to align language models with human and AI preferences

cleanlab

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

trafilatura

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

gpt-llm-trainer

WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

simpleaichat

Python package for easily interfacing with chat apps, with robust features and minimal code complexity.

Llama-Chinese

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

are-copilots-local-yet

Are Copilots Local Yet? The frontier of local LLM Copilots for code completion, project generation, shell assistance, and more. Find tools shaping tomorrow's developer experience, today!

chapyter

Chapyter: ChatGPT Code Interpreter in Jupyter Notebooks

curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

prompts-royale

Automatically create prompts and make them fight each other to know which is the best

MOSS-RLHF

MOSS-RLHF

InternLM

Official release of InternLM2 7B and 20B base and chat models. 200K context support

gpt-prompt-engineer

Baichuan-13B

A 13B large language model developed by Baichuan Intelligent Technology

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".