enricoros / big-AGI

Generative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

Home Page:https://big-agi.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Roadmap] Parameters selection for Beam

kharbandaraghu opened this issue · comments

Why
Users can select temperature, top-p for the models while beaming responses. This would allow them to compare responses from the same model but with different parameters and test which parameters work best for their prompts

Description
In the chat where users can select "Beam" as an option that lets users combine multiple responses from different models and merge them, there is no feature to select the parameters of the model - so users can only choose different models. not same models with different parameters.

Requirements
[ ] add the settings icon next to the model name in dropdown of beam page next to each model just like in the chat window models allowing the users to adjust parameters of the
CleanShot 2024-05-01 at 00 55 51
models
CleanShot 2024-05-01 at 00 55 25
CleanShot 2024-05-01 at 00 51 58

[ ] connect the selected paramteres to the data when sending API requests enabling functionality

Good input. Cross referencing: #483