fulmicoton / kuromoji-rs

Japanese tokenizer for rust

test test_tokenize ... bench: 7,666 ns/iter (+/- 25,545) test test_tokenize ... bench: 5,507 ns/iter (+/- 755)