demo.sh issues in 34b model
Slezge opened this issue · comments
when i run demo.sh in 34b model ,i encounter a mistake,how can i deal with it?
and i already have
in the meantime， i can run 13b model very well
you should explicitly set CUDA_VISIBLE_DEVICES like CUDA_VISIBLE_DEVICES=0,1,2,3