glnmario

Interaction_LLMs

[Personalize@EACL 2024] LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models.

minicons

Utility for behavioral and representational analyses of Language Models

BLL2018

Code and data for the ACL2018 paper 'The Influence of Context on Sentence Acceptability Judgements'

revisiting-uid

Analysis pipeline for Revisiting UID (EMNLP 2021)

chatarena

ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.

binary_metric_tool

Human-Evaluation-Protocol

temporalwiki

[EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models

knowledge-unlearning

[ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models

temporal-drift-on-explanation

Repository for the paper "On the Impact of Temporal Concept Drift on Model Explanations" (EMNLP2022).

diversity-eval

Official Github repo for the paper "Evaluating the Evaluation of Diversity in Natural Language Generation"

Definition_Modeling_Project

asset

A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations

analyzing-uncertainty-nmt

Analyzing Uncertainty in Neural Machine Translation

emnlp-main-findings

BDA of citation counts for papers presented at the EMNLP main conference and Findings of EMNLP 2020

UD_Italian-MarkIT

GRUEN

GRUEN for Evaluating Linguistic Quality of Generated Text (EMNLP 2020 Findings)

HaRT

DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

deep-daze

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

mirostat

Code for the paper-"Mirostat: A Perplexity-Controlled Neural Text Decoding Algorithm" (https://arxiv.org/abs/2007.14966).

norec_fine

Fine-grained sentiment annotations of NoReC

dialog-eval

Evaluate your dialog model with 17 metrics! (see paper)

fssvmdeldcb

TNE

codebase for the Text-based NP Enrichment (TNE) paper

dialign

Automatic and generic measures of verbal alignment in dyadic dialogue based on sequential pattern mining at the level of surface of text utterances

neural-complexity

A neural language model that estimates incremental processing complexity

conventions_model

canard

Repo for the question-in-context rewriting baseline presented in Elgohary et al. "Can you unpack that? Learning to rewrite questions-in-context", EMNLP 2019.

unblend

Will it Unblend? (Findings of EMNLP 2020)