compatability issues with oobabooga
alioop222 opened this issue · comments
Describe the issue
My machine has a requirement for torch==2.0.1a0
It cant find a matching distribution in developer.intel.com. Do you recognise a version with that weird number because i havent seen any versions of anything with alphanumeric codes.
Hi @alioop222 , torch==2.0.1a0 is a version based pytorch v2.0 and has a patch to support Pytorch on Intel GPU.
Could you share where did you find the installation guide with developer.intel.com?
Please try the installation commands in the installation guide to install it:
python -m pip install torch==2.0.1a0 torchvision==0.15.2a0 intel-extension-for-pytorch==2.0.120+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
But I would recommend you to use the latest version v2.1.20 with commands:
python -m pip install torch==2.1.0.post0 torchvision==0.16.0.post0 torchaudio==2.1.0.post0 intel-extension-for-pytorch==2.1.20+xpu oneccl_bind_pt==2.1.200+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
Hi @ZhaoqiongZ
Thanks ill try that. The link came in my terminal output when i was trying to install oobabooga using pinokio. Heres the whole snippet.
Looking in links: https://developer.intel.com/ipex-whl-stable-xpu
ERROR: Could not find a version that satisfies the requirement torch==2.0.1a0 (from versions: 2.0.0, 2.0.1, 2.1.0, 2.1.1, 2.1.2, 2.2.0, 2.2.1, 2.2.2)
ERROR: No matching distribution found for torch==2.0.1a0
Command '. "/Users/alimac/pinokio/api/oobabooga.pinokio.git/text-generation-webui/installer_files/conda/etc/profile.d/conda.sh" && conda activate "/Users/alimac/pinokio/api/oobabooga.pinokio.git/text-generation-webui/installer_files/env" && conda install -y -k ninja git && python -m pip install torch==2.0.1a0 torchvision==0.15.2a0 intel_extension_for_pytorch==2.0.110+xpu -f https://developer.intel.com/ipex-whl-stable-xpu && python -m pip install py-cpuinfo==9.0.0' failed with exit status code '1'.
Exiting now.
Try running the start/update script again.
(base) alimac@Alistairs-Mac-mini text-generation-webui %
The title of the module shows it as running but when i open the UI its just a blank page with an error. Hope this will sort it out. Cheers.
Well i tried it and its blanked me:
(base) alimac@Alistairs-Mac-mini text-generation-webui % python -m pip install torch==2.0.1a0 torchvision==0.15.2a0 intel-extension-for-pytorch==2.0.120+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
Looking in indexes: https://pypi.org/simple, https://pytorch-extension.intel.com/release-whl-aitools/
ERROR: Could not find a version that satisfies the requirement torch==2.0.1a0 (from versions: 2.0.0, 2.0.1, 2.1.0, 2.1.1, 2.1.2, 2.2.0, 2.2.1, 2.2.2)
ERROR: No matching distribution found for torch==2.0.1a0
(base) alimac@Alistairs-Mac-mini text-generation-webui % python -m pip install torch==2.1.0.post0 torchvision==0.16.0.post0 torchaudio==2.1.0.post0 intel-extension-for-pytorch==2.1.20+xpu oneccl_bind_pt==2.1.200+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
Looking in indexes: https://pypi.org/simple, https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
ERROR: Could not find a version that satisfies the requirement torch==2.1.0.post0 (from versions: 2.0.0, 2.0.1, 2.1.0, 2.1.1, 2.1.2, 2.2.0, 2.2.1, 2.2.2)
ERROR: No matching distribution found for torch==2.1.0.post0
(base) alimac@Alistairs-Mac-mini text-generation-webui %
Should i mention im on a mac. This is my GPU:
Intel Iris:
Chipset Model: Intel Iris
Type: GPU
Bus: Built-In
VRAM (Dynamic, Max): 1536 MB
Vendor: Intel
Device ID: 0x0a2e
Revision ID: 0x0009
Metal Family: Supported, Metal GPUFamily macOS 1
Hi @alioop222 , for now we only support OS Windows and Linux, if the OS did not match, it will give the ERROR: No matching distribution found for all the wheels.
But could you please let me know where did you find the download link with https://developer.intel.com/ipex-whl-stable-xpu, it is deprecated and I need to update the doc you follow !
@ZhaoqiongZ I said before, im using pinokio, the one click installer to install oobabooga, and because it didn't load properly i have been trying to complete the installation in my terminal, so its got to be either pinokio or oobabooga or my own codebase that has generated that terminal output which included that link. Here's the full page address resulting from that link which looks like amazon web services if i’m not mistaken, but that’s all i got on that.
http://ec2-52-27-27-201.us-west-2.compute.amazonaws.com/ipex-release.php?device=xpu&repo=us&release=stable
I’m just looking at my terminal output again and this could be relevant:
Command '. "/Users/alimac/pinokio/api/oobabooga.pinokio.git/text-generation-webui/installer_files/conda/etc/profile.d/conda.sh" && conda activate "/Users/alimac/pinokio/api/oobabooga.pinokio.git/text-generation-webui/installer_files/env" && conda install -y -k ninja git && python -m pip install torch==2.0.1a0 torchvision==0.15.2a0 intel_extension_for_pytorch==2.0.110+xpu -f https://developer.intel.com/ipex-whl-stable-xpu && python -m pip install py-cpuinfo==9.0.0' failed with exit status code '1'.
I‘m thinking it could be conda?
Hi @alioop222 , Oh, I searched pinokio and understand your point.
But this is not a pip or conda issue.
Intel extension for pytorch is not yet supported on MacOS, so pip install can not find a wheel which match the MacOS.
@ZhaoqiongZ I just saw this vid last night of a developer writing a file for a voice assistant. Look at this bit where he gets pytorch warnings from python! Maybe it was python pushing out that link. Play from 21.35 i think. https://youtu.be/FmNz1y9EDns?si=KxSmzCannVLevCbC
Hi @alioop222 , as I said Intel extension for pytorch is not yet supported on MacOS, so pip install can not find a wheel which match the MacOS. and it's not a issue for intel extension for pytorch, so I will close the ticket.
@ZhaoqiongZ thats ok i was just telling you because you said you wanted to update that source. Thanks for your help.