i4never

HowToCook

程序员在家做饭方法指南。Programmer's guide about how to cook at home (Simplified Chinese only).

ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

gradio

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

Megatron-LM

Ongoing research training transformer models at scale

LWM

FlagEmbedding

Retrieval and Retrieval-augmented LLMs

sglang

SGLang is a fast serving framework for large language models and vision language models.

RedPajama-Data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

OLMo

Modeling, training, eval, and inference code for OLMo

GPT-4-LLM

Instruction Tuning with GPT-4

NumCpp

C++ implementation of the Python Numpy library

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

MNBVC

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

HunyuanDiT

Hunyuan-DiT : A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding

Chinese-LangChain

中文langchain项目|小必应，Q.Talk，强聊，QiangTalk

chain-of-thought-hub

Benchmarking large language models' complex reasoning ability with chain-of-thought prompting

TigerBot

TigerBot: A multi-language multi-task LLM

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

simple-computer

the scott CPU from "But How Do It Know?" by J. Clark Scott

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

MOSS-RLHF

MOSS-RLHF

clarity-ai

Come join the best place on the internet to learn AI skills. Use code "clarityai" for an extra 20% off.

ml-aim

This repository provides the code and model checkpoints of the research paper: Scalable Pre-training of Large Autoregressive Image Models

xDiT

xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) on multi-GPU Clusters

selfcheckgpt

SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models

long-context-attention

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

NBCE

Naive Bayes-based Context Extension

perplexityai

A python api to use perplexity.ai