lxuechen

quicktype

Generate types and converters from JSON, Schema, and GraphQL

pgvector

Open-source vector similarity search for Postgres

Stockfish

A free and strong UCI chess engine

uvloop

Ultra fast asyncio event loop.

trio

Trio – a friendly Python library for async concurrency and I/O

gateway

A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

schemaorg

Schema.org - schemas and supporting software

sglang

SGLang is a fast serving framework for large language models and vision language models.

nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

mergekit

Tools for merging pretrained large language models.

alphageometry

Awesome-LLM-Inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

swifter

A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner

graph-of-thoughts

Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

sqlacodegen

Automatic model code generator for SQLAlchemy

distributed-llama

Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.

nanotron

Minimalistic large language model 3D-parallelism training

CodeGPT

The leading open-source AI copilot for JetBrains. Connect to any model in any environment, and customize your coding experience in any way you like.

DeepSeek-MoE

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

cc_net

Tools to download and cleanup Common Crawl data

LLMUnity

Create characters in Unity with LLMs!

llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

chess

A rust library to manage chess move generation

shakmaty

A Rust library for chess and chess variant rules and operations

chess_llm_interpretability

Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and representation of player Elo.

hpc-toolkit

Cloud HPC Toolkit is an open-source software offered by Google Cloud which makes it easy for customers to deploy HPC environments on Google Cloud.

chess_gpt_eval

A repo to evaluate various LLM's chess playing abilities.

PytorchBridge

Designing bridge trusses with Pytorch autograd

sample-rate

List of common sample rates