php-tokenizer

There are 0 repository under php-tokenizer topic.

lionsoul2014 / friso
High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other programs, like: MySQL, PostgreSQL, PHP, etc.
c tokenizer chinese-tokenizer php-tokenizer full-text-search chinese-word-segmentation japanese-tokenizer korean-tokenizer cjk-tokenizer
Language:C 474
baygin / php-simple-lexer
The Lexer layer of Compiler/Interpreter
interpreter interpreter-basic lexer php-interpreter php-lexer php-programming-language php-tokenizer tokenizer
Language:PHP 0
soiqualang / php_token
php_token
php-tokenizer
Language:PHP

lionsoul2014 / friso