horizon94's starred repositories
guardrails
Adding guardrails to large language models.
jsonformer
A Bulletproof Way to Generate Structured JSON from Language Models
lm-format-enforcer
Enforce the output format (JSON Schema, Regex etc) of a language model
tensorrtllm_backend
The Triton TensorRT-LLM Backend
TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
rationalizing-neural-predictions
[in progress] pytorch implementation of Tao Lei's rationalizing neural predictions
alpaca_eval
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
LLMTest_NeedleInAHaystack2
Doing simple retrieval from LLM models at various context lengths to measure accuracy
LLMTest_NeedleInAHaystack
Doing simple retrieval from LLM models at various context lengths to measure accuracy
Long-Context-Data-Engineering
Implementation of paper Data Engineering for Scaling Language Models to 128K Context
magvit2-pytorch
Implementation of MagViT2 Tokenizer in Pytorch