into-the-unk

Context-Aware

The implementation of "Does Multi-Encoder Help? A Case Study on Context-AwareNeural Machine Translation"

giza-pp

GIZA++ is a statistical machine translation toolkit that is used to train IBM Models 1-5 and an HMM word alignment model. This package also contains the source for the mkcls tool which generates the word classes necessary for training some of the alignment models.

Korpora

Korean corpus repository

leca

Code for Lexical-Constraint-Aware Neural Machine Translation via Data Augmentation

prnn

Pytorch implementation of Performance RNN

sacrebleu

Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons

transformers

🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

VecConstNMT