rampage644 / pos-crf

Implementation POS tagger project with CRF

Description

POS tagger implementation project using Conditional Random Fields with an aim of getting better understanding of it.

Data

mkdir data
cd data
http http://www.cnts.ua.ac.be/conll2000/chunking/train.txt.gz | gunzip | cut -f1,2 -d" " > pos.train.txt
http http://www.cnts.ua.ac.be/conll2000/chunking/test.txt.gz | gunzip | cut -f1,2 -d " " > pos.test.txt

Useful links

• Intro to CRF
• Lafferty, 2001
• Huang, 2015