device=0 leads to AssertionError: Torch not compiled with CUDA enabled
aashay96 opened this issue · comments
Describe the bug
device is preset to be GPU for instruct hf pipeline. Needs to be taken as input for line 61 and 29. Otherwise it leads to AssertionError: Torch not compiled with CUDA enabled
To Reproduce
Steps to reproduce the behavior:
Run instruct_hf_pipeline.py on a CPU system
Expected behavior
detect GPU or take as input the device
Thanks! Our engineers typically don't work weekends. I'll have this resolved Monday.
Think I've addressed in #46
awesome! Thanks