tals

ColossalAI

Making large AI models cheaper, faster and more accessible

alpaca-lora

Instruct-tune LLaMA on consumer hardware

tailscale

The easiest, most secure way to use WireGuard and 2FA.

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

alpaca.cpp

Locally run an Instruction-Tuned Chat-Style LLM

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios.

tianshou

An elegant PyTorch deep reinforcement learning library.

faster-whisper

Faster Whisper transcription with CTranslate2

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

llama-dl

High-speed download of LLaMA, Facebook's 65B parameter GPT model

T2I-Adapter

T2I-Adapter

keep

The open-source alert management and AIOps platform

CTranslate2

Fast inference engine for Transformer models

maelstrom

A workbench for writing toy implementations of distributed systems.

unipdf

Golang PDF library for creating and processing PDF files (pure go)

samply

Command-line sampling profiler for macOS and Linux

PhySO

Physical Symbolic Optimization

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

intel-extension-for-pytorch

A Python package for extending the official PyTorch that can easily obtain performance on Intel platform

swissgl

SwissGL is a minimalistic wrapper on top of WebGL2 JS API. It's designed to reduce the amount of boilerplate code required to manage GLSL shaders, textures and framebuffers when making procedural visualizations or simulations.

plug-and-play

Official Pytorch Implementation for “Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translation” (CVPR 2023)

ujrpc

Up to 100x Faster FastAPI. JSON-RPC with io_uring, SIMDJSON, and pure CPython bindings

textra

A command-line application to convert images, PDFs, and audio files to text using Apple's APIs

ringrtc

ENeRF

SIGGRAPH Asia 2022: Code for "Efficient Neural Radiance Fields for Interactive Free-viewpoint Video"

ukv

Replacing MongoDB, Neo4J, and Elastic with 1 transactional database. Features: zero-copy semantics, swappable backends, bindings for C, C++, Python, Java, GoLang

confidenceinterval

The long missing library for python confidence intervals

zipslicer

A library for incremental loading of large PyTorch checkpoints

uavm

Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".

auxinash

Official implementation of Auxiliary learning as an Bargaining Game.