PKU-Alignment

PKU-Alignment's repositories

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

Language:PythonApache-2.01180 17 82

OmniSafe is an infrastructural framework for accelerating SafeRL research.

Language:PythonApache-2.0861 38 90

NeurIPS 2023: Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmark

Language:PythonApache-2.0326 9 23

NeurIPS 2023: Safe Policy Optimization: A benchmark repository for safe reinforcement learning algorithms

Language:PythonApache-2.0295 6 10

AI Alignment: A Comprehensive Survey

BeaverTails is a collection of datasets designed to facilitate research on safety alignment in large language models (LLMs).

Language:MakefileApache-2.081 5 5

ProAgent: Building Proactive Cooperative Agents with Large Language Models

Language:JavaScriptMIT37 9 1

ICLR 2024: SafeDreamer: Safe Reinforcement Learning with World Models

Language:PythonApache-2.028 3 2

ReDMan is an open-source simulation platform that provides a standardized implementation of safe RL algorithms for Reliable Dexterous Manipulation.

Language:PythonApache-2.015 30

020