FlagAI-Open / FlagAI

FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Question]:预训练过程中,可以处理文本长度是多少

whl120901318 opened this issue · comments

Description

预训练过程中,可以处理的最大文本序列长度是多少?1024?2048?

Alternatives

No response