Language Technology at the University of Helsinki

Language Technology at the University of Helsinki's repositories

Opus-MT

Open neural machine translation models and web services

Language:PythonMIT613 17 84

OPUS-MT-train

Training open neural machine translation models

Language:MakefileMIT331 18 99

OpusFilter

OpusFilter - Parallel corpus processing toolkit

Language:PythonMIT101 11 36

OPUS-CAT is a collection of software which make it possible to OPUS-MT neural machine translation models in professional translation. OPUS-CAT includes a local offline MT engine and a collection of CAT tool plugins.

Language:C#MIT70 12 96

OpusTools

Language:Python67 8 35

OPUS

The Open Parallel Corpus

Language:JavaScript56 5 12

mammoth

MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki

Language:PythonMIT21 4 31

OPUS-MT-testsets

benchmarks for evaluating MT models

Language:SmalltalkNOASSERTION10 3 14

neural-search-tutorials

Additional Notebooks for the Building NLP Applications course

Language:Jupyter Notebook5 30

OPUS-ingest

Language:Makefile4 5 33

shroom

Language:SCSS4 30

opus-fast-mosestokenizer

c++ mosestokenizer (OPUS fork)

Language:C++LGPL-2.13 2 2

uncertainty-aware-nli

Uncertainty-aware fine-tuning of transformers with NLI data.

Language:PythonMIT3 20

murre24

Manually annotated dataset of Finnish varieties in the Suomi24, the largest Finnish internet forum, the id's of automatically annotated dialectal messages and the scripts used for classification and evaluation.

Language:PythonCC-BY-4.02 20

dialect-topic-model

Scripts and metadata for the paper "Corpus-based dialectometry with topic models"

Language:PythonCC-BY-4.01 10

External-MT-leaderboard

Leaderboards for external MT models

CC-BY-SA-4.01 2 1

lm-vs-mt

A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives

Language:Python1 20

OPUS-API

API for searching corpora from OPUS

Language:Python1 5 5

OPUS-MT-dashboard

Language:PHPMIT1 3 2

OPUS-MT-leaderboard

CC-BY-SA-4.01 3 4

OPUS-MT-leaderboard-recipes

Makefile recipes shared between all leaderboard repos

Language:MakefileCC-BY-SA-4.01 20

OpusDistillery

Training pipelines for Firefox Translations neural machine translation models (adapted for OPUS-MT and integrating GreenNLP metrics)

Language:PythonMPL-2.01 1 5

Contributed-MT-leaderboard

Leaderboard of contributed MT results

CC-BY-SA-4.0020

eflomal

Efficient Low-Memory Aligner

Language:CGPL-3.0000

HPLT-MT-leaderboard

Language:MakefileCC-BY-SA-4.0020

lowres-spain-st

This is the repository that contains all scripts and data from the Helsinki-NLP participation to the WMT24 Shared task: Translation into Low-Resource Languages of Spain

Language:Shell020

LSDC-morph

030

swa_gaussian

Code repo for "A Simple Baseline for Bayesian Uncertainty in Deep Learning" (Helsinki-NLP fork)

Language:Jupyter NotebookBSD-2-Clause010

swag_transformers

Language:PythonMIT050