cjk-tokenizer

There are 0 repository under cjk-tokenizer topic.

lionsoul2014 / friso
High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other programs, like: MySQL, PostgreSQL, PHP, etc.
c tokenizer chinese-tokenizer php-tokenizer full-text-search chinese-word-segmentation japanese-tokenizer korean-tokenizer cjk-tokenizer
Language:C 473

lionsoul2014 / friso