Beast code in Giters

Neil Stoker's starred repositories

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Language:PythonApache-2.035641 347 1721

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Language:PythonApache-2.022399 202 3363

mlc-llm

Universal LLM Deployment Engine with ML Compilation

Language:PythonApache-2.017741 167 1174

coreutils

Cross-platform Rust rewrite of the GNU coreutils

Language:RustMIT17249 195 1531

monkeytype

The most customizable typing website with a minimalistic design and a ton of features. Test yourself in various modes, track your progress and improve your speed.

Language:TypeScriptGPL-3.014572 51 1770

dspy

DSPy: The framework for programming—not prompting—foundation models

Language:PythonMIT14085 125 583

py-spy

Sampling profiler for Python programs

Language:RustMIT12168 112 348

trl

Train transformer language models with reinforcement learning.

Language:PythonApache-2.08720 78 977

Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger

Language:Jupyter NotebookNOASSERTION7850 68 227

o3de

Open 3D Engine (O3DE) is an Apache 2.0-licensed multi-platform 3D engine that enables developers and content creators to build AAA games, cinema-quality 3D worlds, and high-fidelity simulations without any fees or commercial obligations.

Language:C++NOASSERTION7540 147 7456

streaming-llm

[ICLR 2024] Efficient Streaming Language Models with Attention Sinks

Language:PythonMIT6359 60 78

chainlit

Build Conversational AI in minutes ⚡️

Language:TypeScriptApache-2.06103 50 603

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

Language:PythonMIT5750 48 967

awesome-generative-ai

A curated list of modern Generative Artificial Intelligence projects and services

CC0-1.05228 135 24

lit-gpt

Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

Language:PythonApache-2.05189 63 476

PyQt-Fluent-Widgets

A fluent design widgets library based on C++ Qt/PyQt/PySide. Make Qt Great Again.

Language:PythonGPL-3.04969 33 712

CTranslate2

Fast inference engine for Transformer models

Language:C++MIT3036 56 657

revogrid

Powerful virtual data grid smartsheet with advanced customization. Best features from excel plus incredible performance 🔋

Language:TypeScriptMIT2680 35 301

puppeteer-heap-snapshot

API and CLI tool to fetch and query Chome DevTools heap snapshots.

Language:TypeScriptMIT1347 15 6

deep-chat

Fully customizable AI chatbot component for your website

Language:TypeScriptMIT1287 27 218

MatX

An efficient C++17 GPU numerical computing library with Python-like syntax

Language:C++BSD-3-Clause1150 25 156

pyperformance

Python Performance Benchmark Suite

Language:PythonMIT830 60 113

pyperf

Toolkit to run Python benchmarks

Language:PythonMIT758 25 84

webgpu-torch

Tensor computation with WebGPU acceleration

Language:TypeScriptMIT562 17 7

pygls

A pythonic generic language server

Language:PythonApache-2.0541 15 167

pal

PaL: Program-Aided Language Models (ICML 2023)

Language:PythonApache-2.0449 9 14

pyedifice

Declarative GUI framework for Python and Qt

Language:PythonMIT286 8 82

llama2_aided_tesseract

Enhance Tesseract OCR output for scanned PDFs by applying Large Language Model (LLM) corrections, complete with options for text validation and hallucination filtering.

Language:Python221 6 6

problems

Discussions about problems with the current C Api

18 22 65

pgvector-find-faces-talk

The slides and source code for the talk "How I used PostgreSQL® to find pictures of me at a party"

Language:Python6 20

nmstoker