rlhf

There are 15 repositories under rlhf topic.

LAION-AI / Open-Assistant
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
chatgpt language-model rlhf ai assistant discord-bot machine-learning nextjs python
Language:Python 36708
LLaMA-Factory
hiyouga / LLaMA-Factory
Unify Efficient Fine-Tuning of 100+ LLMs
agent ai chatglm fine-tuning gpt instruction-tuning language-model large-language-models llama llama3 llm lora mistral moe peft qlora quantization qwen rlhf transformers
Language:Python 22132
RUCAIBox / LLMSurvey
The official GitHub page for the survey paper "A Survey of Large Language Models".
chain-of-thought chatgpt in-context-learning instruction-tuning large-language-models llm llms natural-language-processing pre-trained-language-models pre-training rlhf
Language:Python 8987
Chinese-LLaMA-Alpaca-2
ymcui / Chinese-LLaMA-Alpaca-2
中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
alpaca llama llm llama-2 large-language-models nlp alpaca-2 flash-attention llama2 alpaca2 64k yarn rlhf
Language:Python 6908
InternLM / InternLM
Official release of InternLM2 7B and 20B base and chat models. 200K context support
chatbot chinese fine-tuning-llm flash-attention gpt large-language-model llm long-context pretrained-models rlhf
Language:Python 5269
alignment-handbook
huggingface / alignment-handbook
Robust recipes to align language models with human and AI preferences
llm rlhf transformers
Language:Python 3912
hiyouga / ChatGLM-Efficient-Tuning
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
chatglm chatgpt fine-tuning lora alpaca peft huggingface language-model transformers pytorch rlhf chatglm2 qlora
Language:Python 3610
argilla
argilla-io / argilla
Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.
human-in-the-loop natural-language-processing mlops developer-tools text-labeling annotation-tool nlp machine-learning active-learning weak-supervision weakly-supervised-learning text-annotation llm ai gpt-4 rlhf langchain
Language:Python 3141
docta
Docta-ai / docta
A Doctor for your data
data data-centric-ai data-centric-machine-learning data-curation data-diagnosis language-model rlhf
Language:Python 2949
opendilab / awesome-RLHF
A curated list of reinforcement learning with human feedback resources (continually updated)
deep-learning deep-reinforcement-learning human-feedback large-language-models reinforcement-learning rlhf
2803
THUDM / WebGLM
WebGLM: An Efficient Web-enhanced Question Answering System (KDD 2023)
chatgpt llm rlhf webglm
Language:Python 1519
PKU-Alignment / safe-rlhf
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
ai-safety alpaca beaver datasets deepspeed gpt large-language-models llama llm llms reinforcement-learning reinforcement-learning-from-human-feedback rlhf safe-reinforcement-learning safe-reinforcement-learning-from-human-feedback safe-rlhf safety transformer transformers vicuna
Language:Python 1171
tatsu-lab / alpaca_eval
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
deep-learning evaluation foundation-models instruction-following large-language-models leaderboard nlp rlhf
Language:Jupyter Notebook 1154
THUDM / ImageReward
[NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation
diffusion-models generative-model rlhf human-preferences
Language:Python 965
distilabel
argilla-io / distilabel
⚗️ distilabel is a framework for synthetic data and AI feedback for AI engineers that require high-quality outputs, full data ownership, and overall efficiency.
ai huggingface llms openai python rlaif rlhf synthetic-data synthetic-dataset-generation
Language:Python 939
xtreme1
xtreme1-io / xtreme1
Xtreme1 is an all-in-one data labeling and annotation platform for multimodal data training and supports 3D LiDAR point cloud, image, and LLM.
annotation-tool annotation computer-vision image-annotation image-classification image-labelling-tool labeling-tool 3d-annotation point-cloud rlhf multimodal
Language:TypeScript 736
GaryYufei / AlignLLMHumanSurvey
Aligning Large Language Models with Human: A Survey
chatgpt gpt-4 large-language-models llms rlhf supervised-finetuning survey awesome chinese-llama llama llama2
607
ContextualAI / HALOs
A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
alignment dpo halos kto ppo rlhf
Language:Python 564
jerry1993-tech / Cornucopia-LLaMA-Fin-Chinese
聚宝盆(Cornucopia): 中文金融系列开源可商用大模型，并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)
llama nlp chinese finance rlhf sft qa text-generation large-language-models transformers
Language:Python 550
voidful / TextRL
Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)
nlp reinforcement-learning language-model nlg controlled-nlg gpt-3 gpt-2 pytorch rlhf chatgpt
Language:Python 519
CambioML / pykoi-rlhf-finetuned-transformers
pykoi: Active learning in one unified interface
ai chatbot feedback language-model llm machine-learning rlhf
Language:Jupyter Notebook 399
mindspore-courses / step_into_llm
MindSpore online courses: Step into LLM
llm natural-language-processing nlp large-language-models mindspore bert chatgpt codegeex gpt gpt2 instruction-tuning parallel-computing prompt-tuning rlhf chatglm chatglm2 llama llama2 moe peft
Language:Python 341
Joyce94 / LLM-RLHF-Tuning
LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)
fine-tuning language-model llama llm lora peft ppo reinforcement-learning rlhf
Language:Python 324
WangRongsheng / MedQA-ChatGLM
🛰️ 基于真实医疗对话数据在ChatGLM上进行LoRA、P-Tuning V2、Freeze、RLHF等微调，我们的眼光不止于医疗问答
chatglm-6b chatgpt dataset fine-tuning freeze huggingface large-language-models llms lora medical rlhf transformer
Language:Python 282
glgh / awesome-llm-human-preference-datasets
A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
awesome-list datasets eval human-preferences llm machine-learning nlp rlhf
254
lhao499 / chain-of-hindsight
Chain-of-Hindsight, A Scalable RLHF Method
large-language-models learning-from-human-feedback rlhf
Language:Python 207
allenai / reward-bench
RewardBench: the first evaluation tool for reward models.
preference-learning rlhf
Language:Python 201
jackaduma / Vicuna-LoRA-RLHF-PyTorch
A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT but with Vicuna
chatgpt finetune gpt llama llm lora peft ppo pytorch reward-models rlhf vicuna vicuna-7b
Language:Python 195
Miraclemarvel55 / ChatGLM-RLHF
对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF
chatglm custom nickname rlhf ppo reward similarity
Language:Python 185
tomekkorbak / pretraining-with-human-feedback
Code accompanying the paper Pretraining Language Models with Human Preferences
ai-alignment ai-safety decision-transformers gpt language-models pretraining reinforcement-learning rlhf
Language:Python 166
jianzhnie / open-chatgpt
The open source implementation of ChatGPT, Alpaca, Vicuna and RLHF Pipeline. 从0开始实现一个ChatGPT.
chatgpt gpt llm rlhf ppo llama stanford-alpaca lora peft
Language:Python 164
xrsrke / instructGOOSE
Implementation of Reinforcement Learning from Human Feedback (RLHF)
chatgpt human-feedback instructgpt reinforcement-learning rlhf
Language:Jupyter Notebook 163
jasonvanf / llama-trl
LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
adapter gpt llama lora peft ppo rlhf trl chatgpt transformer gpt-4
Language:Python 155
csmile-1006 / PreferenceTransformer
Preference Transformer: Modeling Human Preferences using Transformers for RL (ICLR2023 Accepted)
rl rlhf robotics
Language:Python 138
jackaduma / ChatGLM-LoRA-RLHF-PyTorch
A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM
chatglm chatglm-6b chatgpt deepspeed finetune gpt llama llm lora peft ppo pytorch reward-models rlhf
Language:Python 119
liziniu / ReMax
Code for Paper (ReMax: A Simple, Efficient and Effective Reinforcement Learning Method for Aligning Large Language Models)
large-language-models policy-gradient reinforcement-learning rlhf
Language:Python 116

rlhf

LAION-AI / Open-Assistant

hiyouga / LLaMA-Factory

RUCAIBox / LLMSurvey

ymcui / Chinese-LLaMA-Alpaca-2

InternLM / InternLM

huggingface / alignment-handbook

hiyouga / ChatGLM-Efficient-Tuning

argilla-io / argilla

Docta-ai / docta

opendilab / awesome-RLHF

THUDM / WebGLM

PKU-Alignment / safe-rlhf

tatsu-lab / alpaca_eval

THUDM / ImageReward

argilla-io / distilabel

xtreme1-io / xtreme1

GaryYufei / AlignLLMHumanSurvey

ContextualAI / HALOs

jerry1993-tech / Cornucopia-LLaMA-Fin-Chinese

voidful / TextRL

CambioML / pykoi-rlhf-finetuned-transformers

mindspore-courses / step_into_llm

Joyce94 / LLM-RLHF-Tuning

WangRongsheng / MedQA-ChatGLM

glgh / awesome-llm-human-preference-datasets

lhao499 / chain-of-hindsight

allenai / reward-bench

jackaduma / Vicuna-LoRA-RLHF-PyTorch

Miraclemarvel55 / ChatGLM-RLHF

tomekkorbak / pretraining-with-human-feedback

jianzhnie / open-chatgpt

xrsrke / instructGOOSE

jasonvanf / llama-trl

csmile-1006 / PreferenceTransformer

jackaduma / ChatGLM-LoRA-RLHF-PyTorch

liziniu / ReMax