What should be the prompt length?
qgallouedec opened this issue · comments
No, but I don't think it's a big deal to have truncated observations in the prompt. That said, I put 10 a bit randomly, because I couldn't find the value they use in the paper. You could very well increase it to 512, or even set it to seq_len to always have a maximum prompt size. What do you think @edbeeching @ClementRomac?
Originally posted by @qgallouedec in #84 (comment)