sudanl

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

llama3

The official Meta Llama 3 GitHub site

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

CampusShame

互联网仍有记忆！那些曾经在校招过程中毁过口头offer、意向书、三方的公司！纵然人微言轻，也想尽绵薄之力！

weak-to-strong

RAG-Survey

alpaca_eval

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

DeepSeek-LLM

DeepSeek LLM: Let there be answers

textgrad

TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.

DeepSeek-MoE

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

llama-moe

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training

DeepSeek-Math

DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

ruozhiba

Awesome-Knowledge-Distillation-of-LLMs

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

deita

Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]

dl4math

Resources of deep learning for mathematical reasoning (DL4MATH).

magpie

Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality synthetic data generation pipeline!

LLM4Annotation

semantic_uncertainty

Token-level-Direct-Preference-Optimization

Reference implementation for Token-level Direct Preference Optimization(TDPO)

easy-to-hard-generalization

Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"

CalibratedMath

Teaching Models to Express Their Uncertainty in Words

awesome-cultural-nlp

Resources for cultural NLP research

openview_quicklook

awesome-instruction-selector

Paper list and datasets for the paper: A Survey on Data Selection for LLM Instruction Tuning

MathCheck

Is Your Model Really A Good Math Reasoner? Evaluating Mathematical Reasoning with Checklist

privacy-preserving-prompt

Privacy-Preserving Prompt Tuning for Large Language Model

TempoSum

Can LMs Generalize to Future Data? An Empirical Analysis on Text Summarization