kykim0

HALOs

A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

d3po

[CVPR 2024] Code for the paper "Using Human Feedback to Fine-tune Diffusion Models without Any Reward Model"

AlignLLMHumanSurvey

Aligning Large Language Models with Human: A Survey

voice-changer

リアルタイムボイスチェンジャー Realtime Voice Changer

LLM-Agents-Papers

A repo lists papers related to LLM based agent

trl

Train transformer language models with reinforcement learning.

babyagi

improved-aesthetic-predictor

CLIP+MLP Aesthetic Score Predictor

pytorch-GAT

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

yt-dlp

A feature-rich command-line audio/video downloader

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Probabilistic-Programming-and-Bayesian-Methods-for-Hackers

aka "Bayesian Methods for Hackers": An introduction to Bayesian methods + probabilistic programming with a computation/understanding-first, mathematics-second point of view. All in pure Python ;)

MORL

Multi-Objective Reinforcement Learning

stylegan3

Official PyTorch implementation of StyleGAN3

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

lora

Using Low-rank adaptation to quickly fine-tune diffusion models.

rewardedsoups

Rewarded soups official implementation

trlx

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

automl

Google Brain AutoML

llama

Inference code for Llama models

PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

baselines

OpenAI Baselines: high-quality implementations of reinforcement learning algorithms

morl-baselines

Multi-Objective Reinforcement Learning algorithms implementations.

deap

Distributed Evolutionary Algorithms in Python

FewShotLearning

Pytorch implementation of the paper "Optimization as a Model for Few-Shot Learning"

clrs

babyai

BabyAI platform. A testbed for training agents to understand and execute language commands.

deepC

vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers

dm-haiku

JAX-based neural network library