Sm1les

llama.cpp

LLM inference in C/C++

ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

DragGAN

Official Code for DragGAN (SIGGRAPH 2023)

LLaMA-Factory

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

llama2.c

Inference Llama 2 in one file of pure C

pypdf

A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files

DeepSpeedExamples

Example models using DeepSpeed

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

PyMuPDF

PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.

WeChatFerry

微信机器人底层框架，可接入Gemini、ChatGPT、ChatGLM、讯飞星火、Tigerbot等大模型。WeChat Robot Hook.

MedicalGPT

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO。

KuiperInfer

校招、秋招、春招、实习好项目！带你从零实现一个高性能的深度学习推理库，支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step

JittorLLMs

计图大模型推理库，具有高性能、配置要求低、中文支持好、可移植等特点

pythia

The hub for EleutherAI's work on interpretability and learning dynamics

direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

PPOxFamily

PPO x Family DRL Tutorial Course（决策智能入门级公开课：8节课帮你盘清算法理论，理顺代码逻辑，玩转决策AI应用实践 ）

WebCPM

Official codes for ACL 2023 paper "WebCPM: Interactive Web Search for Chinese Long-form Question Answering"

RecurrentGPT

Official Code for Paper: RecurrentGPT: Interactive Generation of (Arbitrarily) Long Text

lilac

Curate better data for LLMs

MAP-NEO

MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

resume

My resume in LaTeX (template suited for new graduates; 应届生简历模板)

Tabular-LLM

本项目旨在收集开源的表格智能任务数据集（比如表格问答、表格-文本生成等），将原始数据整理为指令微调格式的数据并微调LLM，进而增强LLM对于表格数据的理解，最终构建出专门面向表格智能任务的大型语言模型。

CoLLiE

Collaborative Training of Large Language Models in an Efficient Way

ChatPLUG

A Chinese Open-Domain Dialogue System

rwkv-cpp-accelerated

A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependencies

simple-hierarchical-transformer

Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT

chatglm2_finetuning

chatglm2 6b finetuning and alpaca finetuning

tensorlink

Unlock Unlimited Potential! Share Your GPU Power Across Your Local Network!

rmib

The official Implementation code for RMIB: Representation Matching Information Bottleneck for Matching Text Representations (ICML2024)