getting error `OSError: libcurand.so.10: cannot open shared object file: No such file or directory` when finetuning
sambar1729 opened this issue · comments
sambar1729 commented
I am running finetune on falcon-7b
$ falcontune finetune \
--model=falcon-7b \
--weights=tiiuae/falcon-7b \
--dataset=../data/alpaca_data_cleaned.json \
--data_type=alpaca \
--lora_out_dir=./falcon-7b-alpaca/ \
--mbatch_size=1 \
--batch_size=2 \
--epochs=3 \
--lr=3e-4 \
--cutoff_len=256 \
--lora_r=8 \
--lora_alpha=16 \
--lora_dropout=0.05 \
--warmup_steps=5 \
--save_steps=50 \
--save_total_limit=3 \
--logging_steps=5 \
--target_modules='["query_key_value"]'
getting error:
miniconda3/envs/falcontune/lib/python3.9/ctypes/__init__.py", line 382, in __init__
self._handle = _dlopen(self._name, mode)
OSError: libcurand.so.10: cannot open shared object file: No such file or directory
GPU:
NVIDIA Corporation GA104M [GeForce RTX 3080 Mobile / Max-Q 8GB/16GB] (rev a1)
sambar1729 commented
removed and reinstalled cuda, and now this error does not seem to occur.