VKCOM / YouTokenToMe

Unsupervised text tokenizer focused on computational efficiency

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

How does YouTokenToMe's speed compare to subword-nmt?

gowtham1997 opened this issue · comments

Hello,

I took a look at benchmarks page

I wanted to know how YouTokenToMe's speed compares to subword-nmt and is there a reason why it was left out of the benchmarks?