antonio-farinhas

tower-eval

mbr-exec

code for "Natural Language to Code Translation with Execution"

non-exchangeable-conformal-language-generation

robust_MT_evaluation

Repository for "BLEU Meets COMET: Combining Lexical and Neural Metrics Towards Robust Machine Translation Evaluation", accepted at EAMT 2023.

uncertainties_MT_eval

Code and data for the paper "Disentangling Uncertainty in Machine Translation Evaluation", accepted at EMNLP 2022.

UA_COMET

Repository for "Uncertainty-Aware Machine Translation Evaluation", accepted to Findings of EMNLP 2021.

mbr

Minimum Bayes Risk Decoding for Hugging Face Transformers

sparsemax

wmt21-qe-task

MBART Quality Estimator proposed in IST-Unbabel 2021 Submission for the Quality Estimation Shared Task

OpenKiwi

Open-Source Machine Translation Quality Estimation in PyTorch

sparse-marginalization-lvm

Official PyTorch (Lightning) implementation of the NeurIPS 2020 paper "Efficient Marginalization of Discrete and Structured Latent Variables via Sparsity".

COMET

A Neural Framework for MT Evaluation

entmax

The entmax mapping and its loss, a family of sparse softmax alternatives.

maks

Motion Averaging