frankier / FinnPos

CRF-based Morphological Tagging and Lemmatization

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

FinnPos - CRF-based Morphological Tagging and Lemmatization

FinnPos is a morphological tagging and lemmatization toolkit for morphologically rich languages such as Finnish. It is based on the CRF framework and features

  • State-of-the-art tagging accuracy.
  • Fast estimation and application.
  • Support for large label sets exceeding 1000 label types.
  • An option to use taggers for morphological disambiguation.
  • Data driven lemmatization for OOV words.
  • Feature extraction using sub-labels of structured morphological labels (e.g. "Noun+Plural+Nominative").
  • Customizable feature extraction.

FinnPos also provides an accurate morphological tagger for Finnish: FinnTreeBank tagger is trained on a high quality manually annotated Finnish treebank FinnTreeBank 1. FinnTreeBank tagger boosts its tagging accuracy using the open-source Finnish morphological analyzer OMorFi.

FinnPos is licensed under the Apache Software Lincense v2.0. External resources such as morphological analyzers, external software and corpora, that are distributed with this code, may be licensed under different conditions. Their licenses are located in the appropriate directories.

Help for building, installing and using FinnPos may be found in the FinnPos wiki

https://github.com/mpsilfve/FinnPos/wiki

About

CRF-based Morphological Tagging and Lemmatization

License:Apache License 2.0


Languages

Language:C++ 89.3%Language:Python 6.9%Language:Makefile 3.2%Language:Shell 0.5%Language:C 0.1%