SuperXiang

annotated_deep_learning_paper_implementations

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

be_great

A novel approach for synthesizing tabular data using pretrained large language models

BELLE

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

CLAP

Contrastive Language-Audio Pretraining

CLIP

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

how-to-train-tokenizer

怎么训练一个LLM分词器

InstructEval

Evaluation suite for the systematic evaluation of instruction selection methods.

llm-foundry

LLM training code for MosaicML foundation models

lm-human-preferences

Code for the paper Fine-Tuning Language Models from Human Preferences

LM-RMT

Recurrent Memory Transformer

long_llama

LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transformer (FoT) method.

lorahub

mlmc

Code for fine-tuning transformers (XLNet, Bert and GPT-2) on binary, multi-class and multi-label sequence classification tasks.

multipack_sampler

Multipack distributed sampler for fast padding-free training of LLMs

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

sentencepiece_chinese_bpe

使用sentencepiece中BPE训练中文词表，并在transformers中进行使用。

sharegpt

Easily share permanent links to ChatGPT conversations with your friends

Stable-Alignment

Multi-agent Social Simulation + Efficient, Effective, and Stable alternative of RLHF. Code for the paper "Training Socially Aligned Language Models in Simulated Human Society".

t5x

Transnormer

[EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer

trl

Train transformer language models with reinforcement learning.

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

VardaGPT

Associative memory-enhanced GPT-2 model

langchain

⚡ Building applications with LLMs through composability ⚡

llama

Inference code for LLaMA models

llm3s-conatiner

large language model training-3-stages+deployment

olm-datasets

Pipeline for pulling and processing online language model pretraining data from the web

PdfGptIndexer

An efficient tool for indexing and searching PDF text data using OpenAI API and FAISS (Facebook AI Similarity Search) index, designed for rapid information retrieval and superior search accuracy.

torchscale

Transformers at any scale