yechenzhi

generative-models

Generative Models by Stability AI

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

trl

Train transformer language models with reinforcement learning.

PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

LWM

lm-evaluation-harness

A framework for few-shot evaluation of language models.

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

Firefly

Firefly: 大模型训练工具，支持训练Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

cleanrl

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

torchtune

A Native-PyTorch Library for LLM Fine-tuning

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

scenic

Scenic: A Jax Library for Computer Vision Research and Beyond

awesome-RLHF

A curated list of reinforcement learning with human feedback resources (continually updated)

PixArt-alpha

PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis

big_vision

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.

AutoPrompt

A framework for prompt tuning using Intent-based Prompt Calibration

direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models

self-rewarding-lm-pytorch

Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI

safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

self-attention-cv

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

SPIN

The official implementation of Self-Play Fine-Tuning (SPIN)

flash-linear-attention

Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton

HALOs

A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

ao

Custom data types and layouts for training and inference

Vita-CLIP

Official repository for "Vita-CLIP: Video and text adaptive CLIP via Multimodal Prompting" [CVPR 2023]

disco

A Toolkit for Distributional Control of Generative Models

POVID

[Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning

Self-Explore

Self-Explore to avoid ️the p️️it! Improving the Reasoning Capabilities of Language Models with Fine-grained Rewards

LoL-RL

Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients