darrenburns / elia

A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Please add a way to stop/cancel the inference, and Suggestions

LFd3v opened this issue · comments

Hi, there!

Nice project! Thank you for developing and maintaining it!

Maybe I missed something in the help, but is there a way to cancel an inference? If not, I think this could be really useful, specially when trying models locally (specially the big ones that may run very slowly).

Some suggestions (please feel free to ask me to open a separate issue for the ones you may be implemented):

  1. Option to delete chat
  2. Add a secondary keybinding to send a message, maybe Shift + Enter or Ctrl + Enter. Personally, I would prefer that it worked like some messengers can be configured: Enter to send and Shift/Ctrl+Enter to add a line break (maybe add a preference for this?)
  3. Other options to the app "theme"
  4. Tune some variables per chat, like system prompt, temperature, etc
  5. Export the chat (as a MarkDown file?)
  6. Add image to the chat (for multimodal models)

Thanks again. Regards