eyaler / hebrew_tokenizer

A field-tested Hebrew tokenizer for dirty texts (ben-yehuda project, bible, cc100, mc4, opensubs, oscar, twitter) focused on multi-word expression extraction.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

eyaler/hebrew_tokenizer Stargazers