CarperAI / cheese

Used for adaptive human in the loop evaluation of language and embedding models.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

device=0 leads to AssertionError: Torch not compiled with CUDA enabled

aashay96 opened this issue · comments

Describe the bug
device is preset to be GPU for instruct hf pipeline. Needs to be taken as input for line 61 and 29. Otherwise it leads to AssertionError: Torch not compiled with CUDA enabled

To Reproduce
Steps to reproduce the behavior:
Run instruct_hf_pipeline.py on a CPU system

Expected behavior

detect GPU or take as input the device

Thanks! Our engineers typically don't work weekends. I'll have this resolved Monday.

Think I've addressed in #46

awesome! Thanks