ReactiveCJ

fastapi

FastAPI framework, high performance, easy to learn, fast to code, ready for production

llama.cpp

LLM inference in C/C++

expo

An open-source framework for making universal native apps with React. Expo runs on Android, iOS, and the web.

go-micro

A Go microservices framework

Awesome-Chinese-LLM

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

dask

Parallel computing with task scheduling

pgvector

Open-source vector similarity search for Postgres

visdom

A flexible tool for creating, organizing, and sharing visualizations of live, rich data. Supports Torch and Numpy.

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

tiny-dnn

header only, dependency-free deep learning framework in C++14

feast

The Open Source Feature Store for Machine Learning

OOTDiffusion

Official implementation of OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on

Verba

Retrieval Augmented Generation (RAG) chatbot powered by Weaviate

DALI

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

mergekit

Tools for merging pretrained large language models.

torchscale

Foundation Architecture for (M)LLMs

TextAttack

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

awesome-deep-learning-music

List of articles related to deep learning applied to music

exllama

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

LLM-Agent-Survey

llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

dfdx

Deep learning in Rust, with shape checked tensors and neural networks

madmom

Python audio and music signal processing library

lm-format-enforcer

Enforce the output format (JSON Schema, Regex etc) of a language model

Learn-CUDA-Programming

Learn CUDA Programming, published by Packt

client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.

cudarc

Safe rust wrapper around CUDA toolkit

RecAI

Bridging LLM and Recommender System.

python-cityhash

Python bindings for FarmHash and CityHash