Nearest Rounding Kernel

Question

Tiiiger opened this issue 6 years ago · comments

Right now I have only implemented stochastic rounding CUDA kernel. We need to add nearest rounding CUDA kernel.

linzhiqiu · Answer 1 · Wed Oct 10 2018 11:21:50 GMT+0800 (China Standard Time)

Done. Need testing

Tianyi · Answer 2 · Thu Oct 11 2018 11:04:12 GMT+0800 (China Standard Time)

Need to modify quant_module. Please do.

Tianyi · Answer 3 · Thu Oct 11 2018 15:06:02 GMT+0800 (China Standard Time)

Need to Implement nearest rounding for float kernel. See CUDA implementation. You can ignore clip_exponent for now. @linzhiqiu