morganmcg1

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

Language:PythonApache-2.02552 29 243

fully-local-pdf-chatbot

Yes, it's another chat over documents implementation... but this one is entirely local!

Language:TypeScriptMIT1432 12 17

LOMO

LOMO: LOw-Memory Optimization

Language:PythonMIT948 14 70

curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

Language:PythonMIT848 14 31

nanotron

Minimalistic large language model 3D-parallelism training

Language:PythonApache-2.0834 41 58

runhouse

Write local debuggable Python which traverses your powerful remote infra. Deploy as-is. Unobtrusive, unopinionated, PyTorch-like APIs.

Language:PythonApache-2.0815 8 47

raptor

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

Language:PythonMIT560 9 31

client-python

Python client library for Mistral AI platform

Language:PythonApache-2.0401 5 30

code-eval

Run evaluation on LLMs using human-eval benchmark

Language:PythonMIT353 11 7

AgentBoard

An Analytical Evaluation Board of Multi-turn LLM Agents

Language:SAS196 4 7

cleanba

CleanRL's implementation of DeepMind's Podracer Sebulba Architecture for Distributed DRL

Language:PythonNOASSERTION95 4 4

superopenai

Logging and caching superpowers for the openai sdk

Language:Python92 10

llm_recipes

A set of scripts and notebooks on LLM finetunning and dataset creation

Language:Jupyter Notebook71 1 2

transformers-gptq-quant

Language:Python47 20

jinaai-py

Language:PythonApache-2.046 21 16

wandview

Mobile Viewer for W&B, built on top of Flutter.

Language:CNOASSERTION2701

llmtracer

Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp

Language:PythonLGPL-3.012 20

sd-webui-wandb

Language:Python1 10