可以增加个finetune之后的推断脚本吗

Question

llplay opened this issue a year ago · comments

liangwq · Answer 1 · Mon Apr 03 2023 15:15:06 GMT+0800 (China Standard Time)

No description provided.

inference.py和webui文件夹底下就是

llplay · Answer 2 · Mon Apr 03 2023 15:21:27 GMT+0800 (China Standard Time)

有多gpu的版本吗，使用多gpu推断的时候老是报RuntimeError: expected scalar type Half but found Float的错误