TonyNemo

ollama

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

llama.cpp

LLM inference in C/C++

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

unsloth

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

Llama-Chinese

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

cleanlab

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

gpt-prompt-engineer

GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

InternLM

Official release of InternLM2.5 7B base and chat models. 1M context support

MiniCPM

MiniCPM-2B: An end-side LLM outperforming Llama2-13B.

alignment-handbook

Robust recipes to align language models with human and AI preferences

inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

gpt-llm-trainer

simpleaichat

Python package for easily interfacing with chat apps, with robust features and minimal code complexity.

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Baichuan-13B

A 13B large language model developed by Baichuan Intelligent Technology

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

MOSS-RLHF

MOSS-RLHF

nanotron

Minimalistic large language model 3D-parallelism training

curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

chapyter

Chapyter: ChatGPT Code Interpreter in Jupyter Notebooks

prompts-royale

Automatically create prompts and make them fight each other to know which is the best

LLMBox

A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.

are-copilots-local-yet

Are Copilots Local Yet? The frontier of local LLM Copilots for code completion, project generation, shell assistance, and more. Find tools shaping tomorrow's developer experience, today!

condor_tensorflow

CONditionals for Ordinal Regression and classification in tensorflow