kykim0

meta-pretraining

Code accompanying paper: Meta-Learning to Improve Pre-Training

modpo

[Findings of ACL'2024] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization.

uncertain_ground_truth

Dermatology ddx dataset, Jax implementations of Monte Carlo conformal prediction, plausibility regions and statistical annotation aggregation from our recent work on uncertain ground truth (TMLR'23 and ArXiv pre-print).

llm-swarm

Manage scalable open LLM inference endpoints in Slurm clusters

text-clustering

Easily embed, cluster and semantically label text datasets

cosmopedia

NeMo-Aligner

Scalable toolkit for efficient model alignment

LLM101n

LLM101n: Let's build a Storyteller

darts

Differentiable architecture search for convolutional and recurrent networks

oss-guideline

IITP_Guideline 1.0 For Open Source Software RnD Projects operated by yangsuplim at IITP.

rl4co

A PyTorch library for all things Reinforcement Learning (RL) for Combinatorial Optimization (CO)

build-nanogpt

Video+code lecture on building nanoGPT from scratch

betty

Betty: an automatic differentiation library for generalized meta-learning and multilevel optimization

dreamer

Dream to Control: Learning Behaviors by Latent Imagination

nlp-bible-code

자연어처리 바이블의 실습 자료입니다.

KULLM

☁️ 구름(KULLM): 고려대학교에서 개발한, 한국어에 특화된 LLM

SPIN

The official implementation of Self-Play Fine-Tuning (SPIN)

open-instruct

data-selection-survey

A Survey on Data Selection for Language Models

LESS

[ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning

mamba

Mamba SSM architecture

calibration-framework

The net:cal calibration framework is a Python 3 library for measuring and mitigating miscalibration of uncertainty estimates, e.g., by a neural network.

captum

Model interpretability and understanding for PyTorch

tabular-benchmark

OpenFE

OpenFE: automated feature generation with expert-level performance

evolutionary-model-merge

Official repository of Evolutionary Optimization of Model Merging Recipes

reward-bench

RewardBench: the first evaluation tool for reward models.

transformer-debugger

awesome-llm-human-preference-datasets

A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.

enn