Lechatelia

OLMo

Modeling, training, eval, and inference code for OLMo

megablocks

VL-GPT

VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation

MNBVC

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

xjtuthesis

使用 LaTeX 排版学位论文！适用于西安交通大学学生

img2dataset

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

cls_KD

'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)

gill

🐟 Code and models for the NeurIPS 2023 paper "Generating Images with Multimodal Language Models".

Emu

Emu Series: Generative Multimodal Models from BAAI

Visual-Instruction-Tuning

SVIT: Scaling up Visual Instruction Tuning

detrex

detrex is a research platform for DETR-based object detection, segmentation, pose estimation and other visual recognition tasks.

UniD3

nlp-final

reparam-discrete-diffusion

Reparameterized Discrete Diffusion Models for Text Generation

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

BELLE

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

DeepSpeedExamples

Example models using DeepSpeed

llm_training_handbook

An open collection of methodologies to help with successful training of large language models.

Llama-X

Open Academic Research on Improving LLaMA to SOTA LLM

paper-reading

深度学习经典、新论文逐段精读

text-generation-webui

A Gradio web UI for Large Language Models.

torchscale

Foundation Architecture for (M)LLMs

DALL-E

PyTorch package for the discrete VAE used for DALL·E.

EVA

EVA Series: Visual Representation Fantasies from BAAI

Uni-Perceiver

EvoMoE

Hetu

A high-performance distributed deep learning system targeting large-scale and automated distributed training.

Awesome-Mixture-of-Experts-Papers

A curated reading list of research in Mixture-of-Experts(MoE).