jllllll / bitsandbytes-windows-webui

Windows compile of bitsandbytes for use in text-generation-webui.

jllllll/bitsandbytes-windows-webui Issues

Plz add 0.42.0
Closed 3 months ago1
Are you planning new Windows wheels for bitsandbytes above?
Closed 6 months ago8
Installation of bitsandbytes failed on Windows 10
Updated 7 months ago
Error named symbol not found
Updated 8 months ago2
CUDA Setup failed despite GPU being available
Closed 8 months ago3
bitsandbytes error
Updated 8 months ago
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xa0 in position 11: invalid start byte****
Updated 9 months ago2
卸载量化的模型后,不释放显存
Updated 9 months ago
bug report
Updated 9 months ago
ModuleNotFoundError: No module named 'bitsandbytes.cuda_setup.paths'
Closed 9 months ago1
CUDA 12.3 support
Updated 10 months ago1
Could not find module 'e:\Anaconda\envs\torch_v1\lib\site-packages\bitsandbytes\libbitsandbytes_cuda120.dll' (or one of its dependencies). Try using the full path with constructor syntax.
Updated 10 months ago2
现在可以支持cuda12.3的吗
Updated 10 months ago
it seems to have destroyed my 1111 ui
Updated a year ago2
[Feature Request] - Publish to PyPi?
Closed a year ago1
安装这个库后，调用Llama2-Chinese模型时提示 UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
Updated a year ago2
Successfully installed bitsandbytes-0.41.1 BUT it isn't compiled for GPU it says.
Closed a year ago10
Error out of memory at line 88 in file D:\a\bitsandbytes-windows-webui\bitsandbytes-windows-webui\csrc\ops.cu
Updated a year ago1
cuda11.8 安装这个库后尝试运行llama
Closed a year ago
KeyError: 'CONDA_PREFIX'
Closed a year ago3
no gpu support?
Closed a year ago16
Need bitsandbytes0.35.0
Closed a year ago3
UnboundLocalError: local variable 'conda_cuda_libs' referenced before assignment on bitsandbytes 0.40.1post1
Closed a year ago3
[error] win10 cuda12.1_dirver cuda11.8_tools 3090
Closed a year ago2
[bug]Error invalid device ordinal
Closed a year ago10
How to get this module to use cuda121
Closed a year ago2
Unable to install bitsandbytes==0.39.0
Closed a year ago1
Lib is hardcoded to C:
Closed a year ago1
UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
Closed a year ago2