alexrozanski / LlamaChat

Chat with your favourite LLaMA models in a native macOS app

Home Page:https://llamachat.app

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Feature request: Automatically stop generation

TrajansRow opened this issue · comments

It would be nice to have an option to automatically stop generation after a random number of 1-n sentences, delimited by punctuation followed by whitespace. Additionally, it may be helpful to have a "Stop generation at end of sentence" button as an alternative to the current control in the chat window.

Change to this request: Simply expose the reverse-prompt input, which in combination with #17 should provide a versatile method of controlling generation.

@TrajansRow yep good shout. Prompt context is something I want to tackle for the next version so will add it to the list