oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support the Firefox AI API

allo- opened this issue · comments

Description

Recently Firefox got an experimental AI API that integrates a sidebar for general chat and to handle requests initiated from the context menu. Currently, when you select text and choose to create a request via the context menu, it generates a URL of the format http://hostname:port/?q=selected_text%0A%0Aaction+description. The current user interface works well in the sidebar, but it does not support the 'q=' parameter for querying answers directly.

Supporting this feature should be easy and then the text generation webui could be used with Firefox by enabling the settings:

  • browser.ml.chat.hideLocalhost=false
  • browser.ml.chat.provider=http://localhost:7860

Additionally one can think about hiding more UI (e.g the top bar) and having a separate chat history for each session.