THUDM / SwissArmyTransformer

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

https://THUDM.github.io/SwissArmyTransformer

Missing Input?

LingxiaoShawn opened this issue 2 years ago · comments

LingxiaoShawn commented 2 years ago

SwissArmyTransformer/examples/cogview/pretrain_gpt2.py

Line 105 in 7ed825c

tokenizer = get_tokenizer()

I'm not sure that whether the tokenizer of cogview is correctly configured.
Btw nice library! Thank you.