oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Multiple settings aren't saved on restart

Lex-DRL opened this issue · comments

Describe the bug

When restarting webUI, many essential parameters are reset to their defaults with seemingly no way to save them. Specifically:

  • Parameters > Instruction template > Custom system message
    • I clicked around, but couldn't find a way to save it to a template or associate with a model either.
  • The last loaded model.
  • Basically every field on the main Chat page. I personally face it with:
    • Chat style
    • Command for chat-instruct mode

Is there an existing issue for this?

  • I have searched the existing issues

Reproduction

  • Start the webUI with --verbose flag.
  • Go to "Parameters > Instruction template" and set "Custom system message" to some custom string.
  • Load a model, go to "Chat" tab and ask the model something.
  • Verify in terminal that custom system message is indeed added to the context.
  • Close the browser tab and restart webUI - again, with --verbose flag; load the model again.
  • On the "Chat" tab, re-generate the model's response. Verify in terminal that this time system message wasn't added.

Screenshot

No response

Logs

-

System Info

Server (running webUI in local network):
OS: Manjaro Linux
CPU: Intel(R) Core(TM) i7-13700K
GPU: NVIDIA RTX 4090

Client:
OS: Windows 10 x64
Browser: Firefox 131.0.3

Some settings can be saved by using "Save UI defaults" in Session tab.
For example command for chat-instruct mode, some settings from parameters tab, etc.

Hmmm... Thanks for the info.

The issue isn't a bug but a feature request then.
If so, maybe such settings need to be on the same page, which also contains save button?