hmosousa

llama.cpp

LLM inference in C/C++

grok-1

Grok open release

python-fire

Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

mlc-llm

Universal LLM Deployment Engine with ML Compilation

llama2.c

Inference Llama 2 in one file of pure C

mlx

MLX: An array framework for Apple silicon

ml-engineering

Machine Learning Engineering Open Book

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

lm-evaluation-harness

A framework for few-shot evaluation of language models.

LLM-Agent-Paper-List

The paper list of the 86-page paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.

promptbase

All things prompt engineering

alphageometry

torchtune

A Native-PyTorch Library for LLM Fine-tuning

gemma

Open weights LLM from Google DeepMind.

PurpleLlama

Set of tools to assess and improve LLM security.

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

deep-translator

A flexible free and unlimited python tool to translate between different languages in a simple way using multiple translators.

conceptnet-numberbatch

sacrebleu

Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons

pymilvus

Python SDK for Milvus.

latexindent.pl

Perl script to add indentation (leading horizontal space) to LaTeX files. It can modify line breaks before, during and after code blocks; it can perform text wrapping and paragraph line break removal. It can also perform string-based and regex-based substitutions/replacements. The script is customisable through its YAML interface.

annotated-s4

Implementation of https://srush.github.io/annotated-s4

ao

Create and integrate custom data types, layouts and kernels with up to 2x speedups with 65% less VRAM for inference and support for training

CQE

A Framework for Comprehensive Quantity Extraction

croissant-llm-training

Repository containing the code for training the CroissantLLM

CQE_Evaluation

Evaluation script for CQE framework

physio

A conversational AI agent to help with physical rehabilitation.

PT-Pump-Up

Hub for the Portuguese language NLP Resources