cpu上 预测,报错怎么回事呀,GPU上 不会,RuntimeError: invalid multinomial distribution (sum of probabilities <= 0)
AI-Hao07 opened this issue · comments
Traceback (most recent call last):
File "predict.py", line 227, in
main(args)
File "predict.py", line 152, in main
captions = generate(model, clip_embeds, tokenizer, args)
File "predict.py", line 88, in generate
next_token_ids = torch.multinomial(F.softmax(filtered_logits, dim=-1), num_samples=1).squeeze(1).tolist()
RuntimeError: invalid multinomial distribution (sum of probabilities <= 0)