Add tokenization for languages not using spaces

[Jacopo Farina]

The space-based tokenization cannot properly tokenize Chinese and Japanese (among others). For them, add some tokener to be applied in the import script.

References:

• http://tinysegmenter.tuxfamily.org/
• https://github.com/samurais/chop