KeremTurgutlu

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

autogen

A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

marker

Convert PDF to markdown quickly with high accuracy

llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

ml-engineering

Machine Learning Engineering Open Book

text-generation-inference

Large Language Model Text Generation Inference

gpt-prompt-engineer

FastUI

Build better UIs faster.

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

instructor

structured outputs for llms

openchat

OpenChat: Advancing Open-source Language Models with Imperfect Data

marvin

✨ Build AI interfaces that spark joy

trlx

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

alignment-handbook

Robust recipes to align language models with human and AI preferences

helium

Lighter web automation for Python

python-pptx

Create Open XML PowerPoint documents in Python

voyager

🛰️ An approximate nearest-neighbor search library for Python and Java with a focus on ease of use, simplicity, and deployability.

Xwin-LM

Xwin-LM: Powerful, Stable, and Reproducible LLM Alignment

awesome-mojo

A curated list of awesome Mojo 🔥 frameworks, libraries, software and resources

texify

Math OCR model that outputs LaTeX and markdown

hqq

Official implementation of Half-Quadratic Quantization (HQQ)

text2sql-data

A collection of datasets that pair questions with SQL queries.

NEFTune

Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning

shoggoth

Shoggoth is a peer-to-peer network for publishing and distributing open-source Artificial Intelligence

LightSeq

Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers

Data-Provenance-Collection

multipack_sampler

Multipack distributed sampler for fast padding-free training of LLMs

profiling-cuda-in-torch

optimi

Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers