word-alignment

There are 1 repository under word-alignment topic.

THUNLP-MT / Mask-Align
Code for our paper "Mask-Align: Self-Supervised Neural Word Alignment" in ACL 2021
machine-translation self-supervised-learning word-alignment
Language:Python 60
cambridgeltl / ContrastiveBLI
Improving Word Translation via Two-Stage Contrastive Learning (ACL 2022). Keywords: Bilingual Lexicon Induction, Word Translation, Cross-Lingual Word Embeddings.
bilingual-lexicon-induction word-translation contrastive-learning self-learning cross-lingual-word-embeddings mbert pytorch word-alignment cross-lingual-embeddings bilingual-lexicon-extraction bilingual-word-embedding word-embeddings fasttext-embeddings bilingual-dictionary-induction cross-lingual-word-embedding low-resource-machine-translation information-retrieval machine-translation
Language:Python 32
yaoyiran / BLI-Reading-List
A 2024 Reading List for Bilingual Lexicon Induction (BLI) / Word Translation. Frequently Updated.
bilingual-lexicon-extraction bilingual-lexicon-induction bilingual-word-embedding cross-lingual-embeddings cross-lingual-word-embeddings word-alignment word-translation bilingual-dictionary-induction cross-lingual-word-embedding low-resource-machine-translation information-retrieval large-language-models llms word-retrieval
Language:Python 21
Heidelberg-NLP / xsrl_mbert_aligner
X-SRL Dataset. Including the code for the SRL annotation projection tool and an out-of-the-box word alignment tool based on Multilingual BERT embeddings.
semantic-role-labeling srl annotation-projection word-alignment multilingual-srl
Language:Python 15
cambridgeltl / BLICEr
Improving Bilingual Lexicon Induction with Cross-Encoder Reranking (Findings of EMNLP 2022). Keywords: Bilingual Lexicon Induction, Word Translation, Cross-Lingual Word Embeddings.
bilingual-dictionary-induction bilingual-lexicon-extraction bilingual-lexicon-induction bilingual-word-embedding cross-encoder cross-lingual-embeddings cross-lingual-word-embeddings fasttext-embeddings pytorch reranking self-learning word-alignment word-embeddings word-translation xlm-r xlm-roberta low-resource-machine-translation cross-lingual-word-embedding information-retrieval machine-translation
Language:Python 13
sfu-natlang / HMM-Aligner
This is the implementation of word aligner using Hidden Markov Model
natural-language-processing nlp hmm word-alignment hmm-aligner aligner
Language:Python 10
andreabac3 / Word_Alignment_BERT
This project provide an API to perform word alignment
bert word-alignment bert-embeddings embeddings similarity cosine-similarity pytorch deep learning deeplearning machinelearning ai transformers huggingface torch-scatter scatter
Language:Python 9
zhangmozhi / iternorm
Are Girls Neko or Shōjo? Cross-Lingual Alignment of Non-Isomorphic Embeddings with Iterative Normalization (ACL 2019)
cross-lingual-embeddings bilingual-lexicon-extraction word-alignment
Language:Python 9
ruoyuxie / noisy_parallel_data_alignment
Enhanced awesome-align for low-resource languages and noise simulation: https://arxiv.org/abs/2301.09685
low-resource-languages low-resource-nlp noise noisy-data nueral-machine-translation ocr ocr-text word-aligner word-alignment
Language:Python 8
zhangmozhi / retrofit_clwe
Why Overfitting Isn't Always Bad: Retrofitting Cross-Lingual Word Embeddings to Dictionaries (ACL 2020)
cross-lingual-embeddings word-alignment
Language:Python 8
zouharvi / SlowAlignDisplayer
Create "pretty" graphs for aligned sentences
alignment machine-translation word-alignment
Language:TypeScript 7
pixelneo / parapipeline
A pipeline for POS tagging, sentence alignment, word alignment, and transliteration of texts in 30+ languages.
alignment pos-tagging transliteration sentence-alignment udpipe word-alignment
Language:Python 6
qiyuw / WSPAlign
WSPAlign: Word Alignment Pre-training via Large-Scale Weakly Supervised Span Prediction, to appear at ACL 2023 main conference.
acl2023 multilingual nlp weakly-supervised-learning word-alignment
Language:Python 6
lankaraniamir / lyric-source-separation
Using alignments and posteriorgrams extracted from lyrics as novel input into source separation models
lyrics music-information-retrieval source-separation word-alignment
Language:Jupyter Notebook 4
desilinguist / wordalignui
Java application for creating bilingual word alignments
word-alignment java machine-translation visualization
Language:Java 3
qiyuw / WSPAlign.InferEval
Inference library and evaluation script for WSPAlign (https://github.com/qiyuw/WSPAlign)
acl2023 multilingual nlp word-alignment
Language:Python 3
DorinK / Assignment-1-IBM-Models
Assignment 1: Word Alignment in 'Statistical Machine Translation' course by Dr. Roee Aharoni at Bar-Ilan University.
ibm-model1 ibm-model2 statistical-machine-translation word-alignment nlp
Language:Python 2
kukas / word-alignment-visualization
Word Alignment Visualization is a Python package for visualizing word alignments between two sentences in a Jupyter notebook. The package provides an interactive widget that displays original and translated sentences with word alignment lines.
machine-translation nlp word-alignment python-machine-
Language:Jupyter Notebook 2
TajaKuzman / Parlamint-translation
A pipeline for machine translation (using OPUS-MT models) of parliamentary text collections in 30+ languages (ParlaMint corpora). The pipeline includes parsing TEI XLM and CONLL-u files, linguistic processing with the Stanza pipeline, machine translation and word alignment with the Eflomal tool.
conllu dataset-preparation machine-translation word-alignment parlamint
Language:Jupyter Notebook 2
maxkagamine / word-alignment-demo
Demonstration of AI/neural word alignment of English & Japanese text using mBERT-based machine learning models.
japanese machine-learning nlp word-alignment bert language-models natural-language-processing
Language:Python 1
npedrazzini / parallelbibles
Word-alignment models for Bible translations in 100+ historical and contemporary languages
parallel-corpora word-alignment bible-translations kriging multidimensional-scaling
Language:R 1
zouharvi / LeverageAlign
Leveraging Almost Black-Box NMT for Word Alignment
machine-translation word-alignment word-aligner
Language:TeX 1
AdityaYadavalli1 / IBM-Model1
This is simple replica of IBM Model-1. It is trained to find word-alignments between two Indo-European languages - English and Hindi
ibm-model1 nlp word-alignment
Language:Jupyter Notebook
hellomasaya / word-alignment-models
IBM model 1
nlp ibm-model1 word-alignment machine-translation
Language:Jupyter Notebook
pkolachi / wordpairings
Word alignment methods to extract bi/multi -lingual lexica
word-alignment word-aligner multilingual
Language:Python

word-alignment

THUNLP-MT / Mask-Align

cambridgeltl / ContrastiveBLI

yaoyiran / BLI-Reading-List

Heidelberg-NLP / xsrl_mbert_aligner

cambridgeltl / BLICEr

sfu-natlang / HMM-Aligner

andreabac3 / Word_Alignment_BERT

zhangmozhi / iternorm

ruoyuxie / noisy_parallel_data_alignment

zhangmozhi / retrofit_clwe

zouharvi / SlowAlignDisplayer

pixelneo / parapipeline

qiyuw / WSPAlign

lankaraniamir / lyric-source-separation

desilinguist / wordalignui

qiyuw / WSPAlign.InferEval

DorinK / Assignment-1-IBM-Models

kukas / word-alignment-visualization

TajaKuzman / Parlamint-translation

maxkagamine / word-alignment-demo

npedrazzini / parallelbibles

zouharvi / LeverageAlign

AdityaYadavalli1 / IBM-Model1

hellomasaya / word-alignment-models

pkolachi / wordpairings