mst272

Wumbology

WUMBO Algorithm (Weighted UID-filtered Multi-metric Based Outlier detection

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

MedicalGPT

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO。

LLaMA-Factory

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

generative_agents

Generative Agents: Interactive Simulacra of Human Behavior

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

Chatterbox

Chinese large language model

BMTrain

Efficient Training (including pre-training and fine-tuning) for Big Models

ToolBench

[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.

LLMPruner

InstructionZoo

Firefly

Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

torchkeras

Pytorch❤️ Keras 😋😋

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

generative-models

Generative Models by Stability AI

how-to-train-tokenizer

怎么训练一个LLM分词器

reflex

🕸️ Web apps in pure Python 🐍

lilianweng.github.io

My personal page

Magic123

[ICLR24] Official PyTorch Implementation of Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors

networkx

Network Analysis in Python

KokoMind

KokoMind: Can LLMs Understand Social Interactions?

OpenPrompt

An Open-Source Framework for Prompt-Learning.

annotated_deep_learning_paper_implementations

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

nlp-tutorial

NLP新手入门教程

pytorch-image-models

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

SemiCD

Revisiting Consistency Regularization for Semi-supervised Change Detection in Remote Sensing Images

autoclint

A specially designed light version of Fast AutoAugment

fast-autoaugment

Official Implementation of 'Fast AutoAugment' in PyTorch.

Auto-Augment

Reproduction of paper: AutoAugment: Learning Augmentation Strategies from Data