Language Technology at the University of Helsinki

HBMP

Sentence Embeddings in NLI with Iterative Refinement Encoders

XED

XED multilingual emotion datasets

UkrainianLT

A collection of links to Ukrainian language tools

subalign

FoTraNMT

Open Source Neural Machine Translation in PyTorch

OPUS-MT-testsets

benchmarks for evaluating MT models

LanguageCodes

americasnlp2021-st

AmericasNLP 2021 shared task

OPUS-repository

Uplug

Geometry

murreviikko

Dialectologically annotated and normalized dataset of dialectal Finnish tweets

ndc-aligned

Word-aligned version of the Norwegian Dialect Corpus

OpusFilter-hub

A hub of OpusFilter configurations

SELF-FEIL

Emotion Lexicons for Finnish

uralicNLP

An NLP library for small Uralic languages such as Skolt Sami, Moksha and so on

americasnlp2023-st

AmericasNLP 2023 shared task (Helsinki fork)

building-nlp-apps-notebooks

Python notebook demos for the Building NLP Applications course

controlled_simplification_ru

A project on controlled Russian text simplification.

dial_align

Character alignment for normalized dialect corpora

dialect-align-sigmorphon23

murre

The amazing 🐕will normalize non-standard Finnish/Swedish and dialectalize standard Finnish!

OPUS-MT-bot

Translation Bot between Ukrainian and Czech.

OPUS-MT-devsets

development data for OPUS-MT

OPUS-MT-map

A map of available translation models

RuAdapt

A Parallel Russian-Simple Russian Dataset

syntaxmaker

The NLG tool for Finnish

wikitextprocessor

Python package for WikiMedia dump processing (Wiktionary, Wikipedia etc). Wikitext parsing, template expansion, Lua module execution. For data extraction, bulk syntax checking, error detection, and offline formatting.

wiktextract

Wiktionary dump file parser and multilingual data extractor

yasa

yasa is a program that aligns two translations of a text sentence by sentence in order to produce a bi-text