bratao

llm.c

LLM training in simple, raw C/CUDA

phidata

Build AI Assistants with memory, knowledge and tools.

instructor

structured outputs for llms

klogg

Really fast log explorer based on glogg project

schedule_free

Schedule-Free Optimization in PyTorch

R2R

Build and deploy a fully-featured, observable user-facing RAG backend in minutes.

hypercorn

Hypercorn is an ASGI and WSGI Server based on Hyper libraries and inspired by Gunicorn.

llm-datasets

High-quality datasets, tools, and concepts for LLM fine-tuning.

ludic

🌳 Web Development in Pure Python with Type-Guided Components.

wikitextparser

A Python library to parse MediaWiki WikiText

qserve

QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

MoRA

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning

PyxLSTM

PyxLSTM is a Python library that provides an efficient and extensible implementation of the Extended Long Short-Term Memory (xLSTM) architecture. xLSTM enhances the traditional LSTM by introducing exponential gating, memory mixing, and a matrix memory structure, enabling improved performance and scalability for sequence modeling tasks.

zfs-hetzner-vm

script to install Debian 10, 11, 12 and Ubuntu 18, 20, 22 LTS with ZFS root on Hetzner VPS

BAdam

BitMat

An efficent implementation of the method proposed in "The Era of 1-bit LLMs"

fp6_llm

An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).

linearboost-classifier

LinearBoost Classifier is a rapid and accurate classification algorithm that builds upon a very fast, linear classifier.

auto-round

SOTA Weight-only Quantization Algorithm for LLMs. This is official implementation of "Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs"

improved-t5

Experiments for efforts to train a new and improved t5

sailcraft

Data Toolkit for Sailor Language Models

lmquant

memhive

flashT5

A fast implementation of T5/UL2 in PyTorch using Flash Attention

free-threaded-compatibility

A central repository to keep track of the status of work on and support for free-threaded CPython (see PEP 703), with a focus on the scientific and ML/AI ecosystem

AutoMonkey

Python Automation using Mouse and Keyboard, for the masses

winocr

awesome-nlpbr

Curadoria dos melhores links compartilhados no grupo https://t.me/nlpbr no Telegram.

rpapy

RPAPY is a open source easy tool for automating boring stuffs on any screen with robotframework, pyautogui, pywinauto and others.

xlstm-models

xLSTM Language Models