ReactiveCJ

Awesome-Chinese-LLM

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

expo

An open-source framework for making universal native apps with React. Expo runs on Android, iOS, and the web.

LLM-Agent-Survey

Learn-CUDA-Programming

Learn CUDA Programming, published by Packt

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

exllama

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

RecAI

Bridging LLM and Recommender System.

llama.cpp

LLM inference in C/C++

lm-format-enforcer

Enforce the output format (JSON Schema, Regex etc) of a language model

pgvector

Open-source vector similarity search for Postgres

fastapi

FastAPI framework, high performance, easy to learn, fast to code, ready for production

feast

The Open Source Feature Store for Machine Learning

dask

Parallel computing with task scheduling

DALI

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

Verba

Retrieval Augmented Generation (RAG) chatbot powered by Weaviate

torchscale

Foundation Architecture for (M)LLMs

mergekit

Tools for merging pretrained large language models.

python-cityhash

Python bindings for FarmHash and CityHash

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

tiny-dnn

header only, dependency-free deep learning framework in C++14

visdom

A flexible tool for creating, organizing, and sharing visualizations of live, rich data. Supports Torch and Numpy.

madmom

Python audio and music signal processing library

awesome-deep-learning-music

List of articles related to deep learning applied to music

dfdx

Deep learning in Rust, with shape checked tensors and neural networks

cudarc

Safe rust wrapper around CUDA toolkit

go-micro

A Go microservices framework

rust-course

“连续六年成为全世界最受喜爱的语言，无 GC 也无需手动内存管理、极高的性能和安全性、过程/OO/函数式编程、优秀的包管理、JS 未来基石" — 工作之余的第二语言来试试 Rust 吧。<<Rust语言圣经>>拥有全面且深入的讲解、生动贴切的示例、德芙般丝滑的内容，甚至还有JS程序员关注的 WASM 和 Deno 等专题。这可能是目前最用心的 Rust 中文学习教程 / Book

candle

Minimalist ML framework for Rust

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.