takuyaa / yada

Yada is a yet another double-array trie library aiming for fast search and compact data representation.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support offset >= 16_777_216

johtani opened this issue · comments

Hi,

We are using yada in Lindera.
I got an error from yada for building ipadic neologd dictionary with lindera-ipadic-neologd-builder.
See the detail of error in this PR

@johtani I released yada 0.4.0 that may allow you to construct a large double array (up to ~2GB). The limitation of maximum offset is now 536,870,911 which will be enough to build the mecab-ipadic-neologd dictionary.

I will close this issue, but please don't mind to reopen this issue or open other issues if you have any problems on 0.4.0.

Thanks!! I'll try to use it soon. :D