[Roadmap] Parameters selection for Beam
kharbandaraghu opened this issue · comments
Why
Users can select temperature, top-p for the models while beaming responses. This would allow them to compare responses from the same model but with different parameters and test which parameters work best for their prompts
Description
In the chat where users can select "Beam" as an option that lets users combine multiple responses from different models and merge them, there is no feature to select the parameters of the model - so users can only choose different models. not same models with different parameters.
Requirements
[ ] add the settings icon next to the model name in dropdown of beam page next to each model just like in the chat window models allowing the users to adjust parameters of the
models
[ ] connect the selected paramteres to the data when sending API requests enabling functionality
Good input. Cross referencing: #483