ollama / ollama

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

Home Page:https://ollama.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Feature Request: Force-Off ROCm and CUDA builds in `gen_linux.sh` even if they are present.

dreirund opened this issue · comments

Ahoj,

there is a need to force a build without CUDA or ROCm, even if some of their libraries are present on the system.

But current gen_linux.sh forces ROCm build if some libraries are found, even if ROCm is not desired.

Arch Linux AUR package ollama-nogpu-git has a patch to patch out all CUDA and ROCm stuff in gen_linux.sh, but this upstream here seems to change things too fast that it is not feasible to stay up to date with that patch.

So I here wish for a feature to make it built-in that ROCm (and CUDA) build can be forced-off (e.g. by an environment variable or command line switch) even if their libraries or just some of them are present. (On my system, I have only some stuff in /opt/rocm/, which is needed by some package, but is not a full and not a functional ROCm installation. This currently breaks building ollama.)

Regards!

This was recently fixed via #4462 to use the same variables we have on the windows build.