opus-fast-mosestokenizer can't support windows,so this can't run on windows.
thunderlm opened this issue · comments
opus-fast-mosestokenizer can't support windows,so this can't run on windows.
OK, thanks for letting know.
I can't help you with that. But I think that later I replace opus-fast-mosestokenizer by another sentence tokenizer that supports more languages.
btw., @thunderlm , can you please specify how did you realize that "opus-fast-mosestokenizer can't support windows"? Did you try pip install? What happened?
please, @thunderlm , let me know, otherwise I close this issue as not reproducible.
Thanks!