li-plus

chatglm.cpp

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)

chat4u

用微信聊天记录训练一个你专属的聊天机器人

tinypt

A tiny path tracer accelerated by OpenMP & CUDA.

nanoRLHF

Train a tiny LLaMA model from scratch to repeat your words using Reinforcement Learning from Human Feedback (RLHF)

csapp

My CSAPP Lab Solutions

OpenRLHF

A Ray-based High-performance RLHF framework (for large models)

ChatGLM-Tuning

一种平价的chatgpt实现方案, 基于ChatGLM-6B + LoRA

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

li-plus

llama.cpp

Port of Facebook's LLaMA model in C/C++

playground

tinynn

An educational PyTorch-like neural network framework based on NumPy

ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

ChatGLM3

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

CodeGeeX2

CodeGeeX2: A More Powerful Multilingual Code Generation Model

DeepSeek-VL2

DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding

DeepSpeedExamples

Example models using DeepSpeed

ggml

Tensor library for machine learning

GLM-4

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

Gymnasium

An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)

Liger-Kernel

Efficient Triton Kernels for LLM Training

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

sample-factory

High throughput synchronous and asynchronous reinforcement learning

tianshou

An elegant PyTorch deep reinforcement learning library.

torch-mlir

The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

trlx

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

UI-TARS

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs