NeuLab

prompt2model

prompt2model - Generate Deployable Models from Natural Language Instructions

ExplainaBoard

Interpretable Evaluation for AI Systems

BARTScore

BARTScore: Evaluating Generated Text as Text Generation

knn-transformers

PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an implementation of kNN-LM and kNN-MT

InterpretEval

Interpretable Evaluation for (Almost) All NLP Tasks

ReviewAdvisor

Heavy Workload on Reviewing Papers? ReviewAdvisor Helps out

code-bert-score

CodeBERTScore: an automatic metric for code generation, based on BERTScore

gemini-benchmark

external-knowledge-codegen

Code and data for ACL20 paper "Incorporating External Knowledge through Pre-training for Natural Language to Code Generation"

Pangea

This is the repo for the paper "PANGEA: A FULLY OPEN MULTILINGUAL MULTIMODAL LLM FOR 39 LANGUAGES"

cmu-multinlp

Generalizing Natural Language Analysis through Span-relation Representations

langrank

A program to choose transfer languages for cross-lingual learning

REALSumm

REALSumm: Re-evaluating Evaluation in Text Summarization

retomaton

PyTorch code for the RetoMaton paper: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022)

ragged

Retrieval Augmented Generation Generalized Evaluation Dataset

contextual-mt

A repository with the code related to experiments around context-aware machine translation

MultiUI

Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding

cmulab

CMU Linguistic Annotation Backend

ToM-Language-Acquisition

Code used to run experiments for the ICLR 2023 paper "Computational Language Acquisition with Theory of Mind".

AfricanVoices

Hosts text-to-speech corpus and speech synthesizers for African languages.

lti-llm-deployment

explainaboard_web

globalbench

GlobalBench: A Benchmark for Global Progress in Language Technology

KGxBoard

Explainable and Interactive Leaderboard for Evaluation of Knowledge Graph Completion Models

explainaboard_client

lmms-eval-mmllm

ocr-web-interface

OCR web interface using CMULAB backend

cmulab_elan_extension

CMU Linguistic Annotation Backend plugin for ELAN

lti-bloom-deployment

Fast Inference Solutions for BLOOM

tir_tool

Utility tools for tir