ZhangShiyue

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

ParlAI

A framework for training and evaluating AI models on a variety of openly available dialogue datasets.

gpt-2-output-dataset

Dataset of GPT-2 outputs for research in detection, biases, and more

Llama-X

Open Academic Research on Improving LLaMA to SOTA LLM

LLMTest_NeedleInAHaystack

Doing simple retrieval from LLM models at various context lengths to measure accuracy

pytorch-struct

Fast, general, and tested differentiable structured prediction in PyTorch

test

Measuring Massive Multitask Language Understanding | ICLR 2021

berkeley-doc-summarizer

The Berkeley Document Summarizer is a learning-based, single-document summarization system that extracts source document content, exploits syntactic information to compress it, and uses coreference constraints to ensure clarity.

chatgpt-failures

Failure archive for ChatGPT and similar models

SummEval

Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper

factCC

Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper

Multi-News

Large-scale multi-document summarization dataset and code

mauve

Package to compute Mauve, a similarity score between neural text and human text. Install with `pip install mauve-text`.

simple-web-audio-recorder-demo

A simple HTML/JS demo that uses WebAudioRecorder.js to record audio on a web page

gold-off-policy-text-gen-iclr21

qamr

Question-Answer Meaning Representation

repro

Repro is a library for easily running code from published papers via Docker.

longeval-summarization

Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https://arxiv.org/abs/2301.13298).

MTAdam

MTAdam: Automatic Balancing of Multiple Training Loss Terms

ROSE

SummarizationPrograms

[ICLR 2023] PyTorch code of Summarization Programs: Interpretable Abstractive Summarization with Neural Modular Trees

QANom

MixCE-acl2023

Implementation of MixCE method described in ACL 2023 paper by Zhang et al.

qasrl

Tools for working with QA-SRL data and annotating it with crowdsourcing.

LitePyramids

Method for evaluating system summaries manually, via crowdsourcing, using a summarization dataset that includes reference summaries.

truncation-sampling

Codebase describing experiments in Truncation Sampling as Language Model Desmoothing

QA-ALIGN

QA-ALIGN: Representing Cross-Text Content Overlap by Aligning Question-Answer Propositions

ginn

A minimalistic, header only neural net library

qasrl-crowdsourcing