Tom pei's repositories
human-learning-optimization
HLO:human learning optimization
bigcode-evaluation-harness
A framework for the evaluation of autoregressive code generation language models.
ColossalAI
Making large AI models cheaper, faster and more accessible
csghub
CSGHub is an opensource large model assets platform just like on-premise huggingface which helps to manage datasets, model files, codes and more. CSGHub是一个开源、可信的大模型资产管理平台,可帮助用户治理LLM和LLM应用生命周期中涉及到的资产(数据集、模型文件、代码等)。CSGHub提供类似私有化的Huggingface功能,以类似OpenStack Glance管理虚拟机镜像、Harbor管理容器镜像以及Sonatype Nexus管理制品的方式,实现对LLM资产的管理。欢迎关注反馈和Star⭐️
gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
Llama2-Chinese
Llama中文社区,最好的中文Llama大模型,完全开源可商用
rayfed
A multiple parties joint, distributed execution engine based on Ray, to help build your own federated learning frameworks in minutes.
DHS-LLM-Workshop
DHS 2023 LLM Workshop by Sourab Mangrulkar
lit-gpt
Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
lm-evaluation-harness
A framework for few-shot evaluation of language models.
Megatron-LM
Ongoing research training transformer models at scale
Open-Sora
Building your own video generation model like OpenAI's Sora
starcoder
Home of StarCoder: fine-tuning & inference!
TinyLlama
The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.