Seonghwan Kim's starred repositories
ML-Papers-of-the-Week
🔥Highlighting the top ML papers every week.
gemma_pytorch
The official PyTorch implementation of Google's Gemma models
schedule_free
Schedule-Free Optimization in PyTorch
awesome-llm-powered-agent
Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...
DataDreamer
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
RLHF-Reward-Modeling
Recipes to train reward model for RLHF.
ringattention
Transformers with Arbitrarily Large Context
ring-flash-attention
Ring attention implementation with flash attention
textbook_quality
Generate textbook-quality synthetic LLM pretraining data
large_language_model_training_playbook
An open collection of implementation tips, tricks and resources for training large language models
BlackMamba
Code repository for Black Mamba
RethinkTinyLM
[ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
Inflection-Benchmarks
Public Inflection Benchmarks
prepacking
The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
ko-rm-judge
Reward Model을 이용하여 언어모델의 답변을 평가하기