coreylowman / cudarc

Safe rust wrapper around CUDA toolkit

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Unable to find curand lib under the names ...

EricLBuehler opened this issue · comments

Hello all,

Thanks for the great work here. While using cudarc on a Windows machine, we ran into the following issue: it does not detect the curand DLL. Here is some more information:

mistralrs-server.exe gguf -m . -f Mistral-7B-Instruct-v0.3-Q6_K.gguf

thread 'main' panicked at C:\Users\[REDACTED]\.cargo\registry\src\index.crates.io-6f17d22bba15001f\cudarc-0.11.3\src\curand\sys\mod.rs:51:9:
Unable to find curand lib under the names ["curand", "curand64", "curand64_12", "curand64_125", "curand64_125_0", "curand64_120_5"]. Please open GitHub issue.
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

We have CUDA version 12.5 on Windows:

$ which curand64_10.dll
/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.5/bin/curand64_10.dll

I think that this may be related to #240, and the solution is as simple as adding curand64_10 to the searchable names? Thank you!

Cool I'll get a fix in for this. I've noticed this for curand as well. I'm not sure why there is a 10 in the name. But yeah I think we can just add {lib_name}{pointer_width}_10 into the searchable names!