Token indices sequence length is longer than the specified maximum sequence length for this model (XXX > 512). Running this sequence through the model will result in indexing errors
Ehsan-Yaghoubi opened this issue · comments
During training the model, I frequently receive the following warning:
Token indices sequence length is longer than the specified maximum sequence length for this model (590 > 512). Running this sequence through the model will result in indexing errors.
The number 590 varies in each warning, for example, 793, 743, ...
Questions:
1- This warning is harmless?
2- When using LLaVA-1.5v weights, it leads to an Assertion error: assert cur_len == total_len. It is line 135 of the dataset.py. Any suggestions to resolve the error?
I also come across this warning, is there any solution for it now?