Wenbosi

CharacterEval

CriticBench

[ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning

Themis

The official repository for our NLG evaluation LLM Themis and the paper Themis: Towards Flexible and Interpretable NLG Evaluation.

gpo

The code of paper "Toward Optimal LLM Alignments Using Two-Player Games".

geval

Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"

Topical-Chat

A dataset containing human-human knowledge-grounded open-domain conversations.

WildBench

Benchmarking LLMs with Challenging Tasks from Real Users

arena-hard-auto

Arena-Hard-Auto: An automatic LLM benchmark.

FBI

FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists

ComplexBench

sep

Code release for "Learning to Generate Explainable Stock Predictions using Self-Reflective Large Language Models" https://arxiv.org/abs/2402.03659

sthan-sr-aaai

ToMBench

ToMBench: Benchmarking Theory of Mind in Large Language Models, ACL 2024.

autosearch-grammarly-premium-cookie

免费白嫖使用Grammarly Premium高级版

textgrad

TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.

Directional-Stimulus-Prompting

[NeurIPS 2023] Codebase for the paper: "Guiding Large Language Models with Directional Stimulus Prompting"

self-refine

LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.

SelFee

Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"

Collie

[ICLR 2024] COLLIE: Systematic Construction of Constrained Text Generation Tasks

FollowBench

Code for "FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models (ACL 2024)"

CELLO

Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)

THU-ACP

This is the repository for my Advanced Computing courses at the Computer Science and Technology department of Tsinghua University.

Shepherd

This is the repo for the paper Shepherd -- A Critic for Language Model Generation

MetaRanking

Official code repo for our work "Meta Ranking: Less Capable Language Models are Capable for Single Response Judgement".

CUT

Source code of "Reasons to Reject? Aligning Language Models with Judgments"

DeepSeek-Math

DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

MetaCritique

Evaluate the Quality of Critique

instruction-induction

LLM-Safeguard

Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"

ceval

Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]