Haoxiang-Wang

fms-fsdp

🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

SciCode

A benchmark that challenges language models to code solutions for scientific problems

PINE

Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""

Adam-mini

Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793

reward-bench

RewardBench: the first evaluation tool for reward models.

bedirt.github.io

My personal website

kopytjuk.github.io

hugo-PaperMod

A fast, clean, responsive Hugo theme.

rlftqc

Reinforcement Learning for Fault-Tolerant Quantum Circuit Discovery

qdx

Quantum error correction code AI-discovery with Jax

CodeUltraFeedback

CodeUltraFeedback: aligning large language models to coding preferences

2025QuantInternships

Public quant internship repository, maintained by NUFT but available for everyone.

RLHF-Reward-Modeling

Recipes to train reward model for RLHF.

grok-1

Grok open release

Directional-Preference-Alignment

Directional Preference Alignment

flash-attention

Fast and memory-efficient exact attention

unified-io-2

easse

Easier Automatic Sentence Simplification Evaluation

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

prometheus

[ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically designed for fine-grained evaluation on a customized score rubric, Prometheus is a good alternative for human evaluation and GPT-4 evaluation.

Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

trl

Train transformer language models with reinforcement learning.

GOAT

LLaMA-Factory

A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

FLASK

[ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets

lm-evaluation-harness

A framework for few-shot evaluation of language models.

axolotl

Go ahead and axolotl questions

tensor_parallel

Automatically split your PyTorch models on multiple GPUs for training & inference

RAFA_code

mint-bench

Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Zihan Wang*, Jiateng Liu, Yangyi Chen, Lifan Yuan, Hao Peng and Heng Ji.