Atinoda / text-generation-webui-docker

Docker variants of oobabooga's text-generation-webui, including pre-built images.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Unable to run oobabot-plugin, missing python oobabot_plugin module

Casuallynoted opened this issue · comments

Currently able to install oobabot-plugin,but once installed it does not run due to not having the necessary module installed. Is there a way to specify additional modules to install on bootup?

Hi @Casuallynoted - I haven't tried out that plugin, but I suggest that you map it's folder to the host using the docker-compose.yml - there's examples in there - and then add it to BUILD_EXTENSIONS_LIVE environment variables and it should install dependencies each time the container is started. I' have taken a note to try this out myself when I get a chance, but hopefully this will get you up and running!

Sorry for taking so long to get back to you on this, I did give this a try but sadly the issue is still sticking around.

Update: Made some progress! I installed it as per the instructions in the oobabot-plugin repo and then create a requirements.txt with simply:

oobabot-plugin

In it, and then set to build the extension "oobabot" live- now it's grabbing the requirement via pip and attempting to launch oobabooga, but then it throws this:

2024-03-30 00:52:37.820220-04:00�[33;40m2024-03-30 04:52:37,819�[0m�[37;40m DEBUG �[0m�[36;40moobabot_plugin: inside Oobabooga, using script.py version: 0.1.8�[0m
2024-03-30 00:52:37.820260-04:00�[33;40m2024-03-30 04:52:37,819�[0m�[37;40m DEBUG �[0m�[36;40moobabot_plugin version: 0.2.3�[0m
2024-03-30 00:52:37.820279-04:00�[33;40m2024-03-30 04:52:37,819�[0m�[37;40m DEBUG �[0m�[36;40moobabot version: 0.2.3�[0m
2024-03-30 00:52:38.072078-04:00╭───────────────────── Traceback (most recent call last) ──────────────────────╮
2024-03-30 00:52:38.072143-04:00│ /app/server.py:254 in │
2024-03-30 00:52:38.072154-04:00│ │
2024-03-30 00:52:38.072162-04:00│ 253 # Launch the web UI │
2024-03-30 00:52:38.072170-04:00│ ❱ 254 create_interface() │
2024-03-30 00:52:38.072188-04:00│ 255 while True: │
2024-03-30 00:52:38.072196-04:00│ │
2024-03-30 00:52:38.072205-04:00│ /app/server.py:156 in create_interface │
2024-03-30 00:52:38.072213-04:00│ │
2024-03-30 00:52:38.072227-04:00│ 155 │
2024-03-30 00:52:38.072235-04:00│ ❱ 156 extensions_module.create_extensions_tabs() # Extensions tabs │
2024-03-30 00:52:38.072243-04:00│ 157 extensions_module.create_extensions_block() # Extensions bloc │
2024-03-30 00:52:38.072251-04:00│ │
2024-03-30 00:52:38.072264-04:00│ /app/modules/extensions.py:207 in create_extensions_tabs │
2024-03-30 00:52:38.072272-04:00│ │
2024-03-30 00:52:38.072280-04:00│ 206 with gr.Tab(display_name, elem_classes="extension-tab"): │
2024-03-30 00:52:38.072288-04:00│ ❱ 207 extension.ui() │
2024-03-30 00:52:38.072301-04:00│ 208 │
2024-03-30 00:52:38.072309-04:00│ │
2024-03-30 00:52:38.072317-04:00│ /app/extensions/oobabot/script.py:28 in ui │
2024-03-30 00:52:38.072325-04:00│ │
2024-03-30 00:52:38.072337-04:00│ 27 """ │
2024-03-30 00:52:38.072345-04:00│ ❱ 28 bootstrap.plugin_ui( │
2024-03-30 00:52:38.072353-04:00│ 29 script_py_version=SCRIPT_PY_VERSION, │
2024-03-30 00:52:38.072361-04:00│ │
2024-03-30 00:52:38.072375-04:00│ /venv/lib/python3.10/site-packages/oobabot_plugin/bootstrap.py:86 in │
2024-03-30 00:52:38.072383-04:00│ plugin_ui │
2024-03-30 00:52:38.072391-04:00│ │
2024-03-30 00:52:38.072398-04:00│ 85 api_extension_loaded = False │
2024-03-30 00:52:38.072416-04:00│ ❱ 86 if shared.args.api_streaming_port: │
2024-03-30 00:52:38.072424-04:00│ 87 streaming_port = shared.args.api_streaming_port │
2024-03-30 00:52:38.072432-04:00╰──────────────────────────────────────────────────────────────────────────────╯
2024-03-30 00:52:38.072448-04:00AttributeError: 'Namespace' object has no attribute 'api_streaming_port'

Which I believe may have to do with me not having api enabled in oobabooga, I'll check and report back!

Oof ok, I think this is starting to go outside the scope of this project. It looks like the official repo for the plugin itself is outdated and it hasn't been made to work with the latest ooba. There's a fork that appears to have fixed the issues here: https://github.com/EugeoSynthesisThirtyTwo/oobabot-plugin/tree/main/src/oobabot_plugin but since the installer depends on downloading a precompiled version via pip, I'm not really sure how to get around that and force it to use this version. I think for now I might leave this as-is and if the maker of that fork submits a pr to the original and it gets merged/updated then I'll try again.

But thank you so so much for all of your help, this docker setup is still hella useful to me and I'mma continue to use it. :)

Thank you for your kind comments and I'm really glad that the image is useful to you! I'll consider your situation almost as a new feature - thank you for sharing the details - and think about how to do it. These frameworks are constantly developing so I think there is a call to be able to do what you are pushing towards. I'll try to get some time and get this working with docker too - if I get any joy I'll report back here. Equally, if you get it working, please do post again and I'll see if I can roll the necessary parts into the image.