muupan

LLaMA-Factory

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

Karabiner-Elements

Karabiner-Elements is a powerful utility for keyboard customization on macOS Sierra (10.12) or later.

unsloth

Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

Vim

:star: Vim for Visual Studio Code

flash-attention

Fast and memory-efficient exact attention

Gymnasium

An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)

lm-evaluation-harness

A framework for few-shot evaluation of language models.

alignment-handbook

Robust recipes to align language models with human and AI preferences

llm-numbers

Numbers every LLM developer should know

direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

mathematics_dataset

This dataset code generates mathematical question and answer pairs, from a range of question types at roughly school-level difficulty.

hh-rlhf

Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"

alpaca_eval

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

CameraController

📷 Control USB Cameras from an app

safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

open-instruct

awesome-japanese-nlp-resources

A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese

NeMo-Aligner

Scalable toolkit for efficient model alignment

SPPO

The official implementation of Self-Play Preference Optimization (SPPO)

Online-RLHF

A recipe for online RLHF and online iterative DPO.

qv

Quickly view your data

evals

vscode-journal

Lightweight journal and simple notes support for Visual Studio Code

llm-japanese-dataset

LLM構築用の日本語チャットデータセット

EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

japanese-llm-ranking

exact-optimization

ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment

CPO_SIMPO

This repository contains the joint use of CPO and SimPO method for better reference-free preference learning methods.

instruction_ja

Japanese instruction data (日本語指示データ)