RuntimeError: "LayerNormKernelImpl" not implemented for 'Half' torch

Question

james-see opened this issue 2 years ago · comments

Using cpu on Mac M1 I came across this error. It appears that to fix it, you need to make sure that the dtype is float32.

JC · Answer 1 · Fri Jul 22 2022 20:51:37 GMT+0800 (China Standard Time)

I would add this to the readme as an example for how to get it working in CPU mode to avoid this error.

Brett Kuprel · Answer 2 · Sat Jul 23 2022 01:23:22 GMT+0800 (China Standard Time)

Interesting, I haven't tried float16 with cpu. Thanks for pointing this out