Vocabulary
vthost opened this issue · comments
Hi,
Thank you so much for sharing the code!
I want to use it and am wondering if it is fair to generate the vocabulary based on all data. In NLP, for example, it is standard to exclude the test data. (I guess you have a reason I am just curious.) Thank you already!