kurisusnowdeng

Cubework

ones_sc21

ColossalAI-BERT

Tensor-parallel BERT implemeneted by ColossalAI

leetcode

leetcode solutions

ColossalAI

Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training

ColossalAI-Benchmark

Performance benchmarking with ColossalAI

ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI

dist_opt

MNBVC

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

poj

poj solutions

pytorch-distributed-cifar

ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a toolkit of libraries (Ray AIR) for accelerating ML workloads.

UniTAB

UniTAB: Unifying Text and Box Outputs for Grounded VL Modeling, ECCV 2022 (Oral Presentation)