qwopqwop200 / GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Unable to run 'python setup_cuda.py install'

alannoote96 opened this issue · comments

Hello, I'm attempting to execute the following steps in this document: https://huggingface.co/blog/chatbot-amd-gpu
But I get stuck at this point: Unable to run 'python setup_cuda.py install'

It seems like something is missing inorder to run. I dont have much experience with python itself.
I ran pip install -r requirements.txt which ran without any errors.
Also to note this was on the cuda branch.

Logs: logs.txt

Does someone have a possible solution for the given problem? Thanks in advance.