oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Implement an extension showing the alternative words the model could have chosen - similar to the following project.

marknasr22 opened this issue · comments

commented

Description
It would be great if an extension is implemented for showing the alternative words/tokens the model could have chosen and a possibility to choose any of the words to continue generating from there. Here is the standalone project that does that.

https://github.com/TC-Zheng/ActuosusAI