xiye17

webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"

MuSR

FActScore

A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"

MiniChain

A tiny library for coding with large language models.

KENLG-Reading

Author: Wenhao Yu (wyu1@nd.edu). ACM Computing Survey'22. Reading list for knowledge-enhanced text generation, with a survey.

LabelInspect

MutualDetector

DataLinker

A web-based tool for interative improving graph-based semi-supervised learning models

Visual-Analytics-Data-Quality

OoDAnalyzer

A web-based tool for analyzing out-of-distribution samples.

libsampling

A library of sampling algorithms

FSLDiagnotor

A web-based tool for diagnosing ensemble few-shot classifiers

DescribeDistributionalDifferences

Code for preprint: Summarizing Differences between Text Distributions with Natural Language

training-dynamics-generation

metaseq

Repo for external large-scale work

lattice-generation

Code for Massive-scale Decoding for Text Generation using Lattices

rng-kbqa

QA-Verification-Via-NLI

Code and dataset for the EMNLP 2021 Finding paper "Can NLI Models Verify QA Systems’ Predictions?"

Meta-tuning

EMNLP 2021 Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections

GrailQA

tensor2struct-public

Semantic parsers based on encoder-decoder framework

sum-interpret

Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)

TestSuiteEval

"Semantic Evaluation for Text-to-SQL with Distilled Test Suite", EMNLP2020

shap

A game theoretic approach to explain the output of any machine learning model.

dae-factuality

hans

Heuristic Analysis for NLI Systems

text-sum-uncertainty

Code for "Understanding Neural Abstractive Summarization Models via Uncertainty" (EMNLP20)

diffmask

Pytorch implementation of DiffMask

CodeXGLUE

CodeXGLUE

task_oriented_dialogue_as_dataflow_synthesis

Code to reproduce experiments in the paper "Task-Oriented Dialogue as Dataflow Synthesis" (TACL 2020).