[Question]:预训练过程中,可以处理文本长度是多少
whl120901318 opened this issue · comments
Description
预训练过程中,可以处理的最大文本序列长度是多少?1024?2048?
Alternatives
No response
2048
FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.
whl120901318 opened this issue · comments
预训练过程中,可以处理的最大文本序列长度是多少?1024?2048?
No response
2048