Beam: continue chats in beam per model, or with all models
dandv opened this issue · comments
Why
The ability to continue chats in a Beam would enable users to:
- compare the reasoning of multiple models without necessarily wanting to obtain one merged answer
- guide each model towards a "final" answer, then fusing them
Description
After starting a Beam, I'd like the ability to continue the chat with each model individually, or to send the same message to all models. At any point, it should still be possible to merge the last answers into one.
Thanks for the request, probably the least intrusive way to keep chatting would be to show a "message bubble" on the bottom-left corner (the bottom-right has the "done" actions). #483
Once the message bubble is pressed, it should show a small 1-line input box, which could be used to chat (very simple traditional text chat) with the individual response, and the assumption is that the last response in each "thread" is the one considered for the merge.