Jue WANG's repositories
LorrinWWW.github.io
Jue's blog
DeeperSpeed
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
GLM-130B
GLM-130B: An Open Bilingual Pre-Trained Model
advertorch
A Toolbox for Adversarial Robustness Research
ChatGPT-Next-Web
A cross-platform ChatGPT/Gemini UI (Web / PWA / Linux / Win / MacOS). 一键拥有你自己的跨平台 ChatGPT/Gemini 应用。
FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.
FLASK
[ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
fmengine-torch
FMEngine [PyTorch version]
gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
helm
Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110).
icetk
A unified tokenization tool for Images, Chinese and English.
json-stream
Simple streaming JSON parser and encoder.
LLM-Pruner
[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support LLaMA, Llama-2, BLOOM, Vicuna, Baichuan, etc.
lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
lm-format-enforcer
Enforce the output format (JSON Schema, Regex etc) of a language model
natural-instructions
Expanding natural instructions
Open-Instruction-Generalist
Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
open_clip
An open source implementation of CLIP.
RedPajama-Data
The RedPajama-Data repository contains code for preparing large datasets for training large language models.
scaled-rope
Lora
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs