lxuechen

graph-of-thoughts

Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"

schemaorg

Schema.org - schemas and supporting software

trio

Trio – a friendly Python library for async concurrency and I/O

uvloop

Ultra fast asyncio event loop.

swifter

A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner

pgvector

Open-source vector similarity search for Postgres

sqlacodegen

Automatic model code generator for SQLAlchemy

CodeGPT

JetBrains extension providing access to state-of-the-art LLMs, such as GPT-4, Claude 3, Code Llama, and others, all for free

quicktype

Generate types and converters from JSON, Schema, and GraphQL

distributed-llama

Tensor parallelism is all you need. Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.

nanotron

Minimalistic large language model 3D-parallelism training

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

alphageometry

sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

sample-rate

List of common sample rates

gateway

A Blazing Fast AI Gateway. Route to 200+ LLMs with 1 fast & friendly API.

llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

LLMUnity

Create characters in Unity with LLMs!

chess

A rust library to manage chess move generation

shakmaty

A Rust library for chess and chess variant rules and operations

Stockfish

A free and strong UCI chess engine

chess_llm_interpretability

Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and representation of player Elo.

chess_gpt_eval

A repo to evaluate various LLM's chess playing abilities.

Awesome-LLM-Inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

PytorchBridge

Designing bridge trusses with Pytorch autograd

nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

hpc-toolkit

Cloud HPC Toolkit is an open-source software offered by Google Cloud which makes it easy for customers to deploy HPC environments on Google Cloud.

cc_net

Tools to download and cleanup Common Crawl data

DeepSeek-MoE

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

mergekit

Tools for merging pretrained large language models.