How to test inference speed?

Question

JianbangZ opened this issue a year ago · comments

Anyway we can test the speedup effect?

Denis Kuznedelev · Answer 1 · Wed Jun 14 2023 16:44:13 GMT+0800 (China Standard Time)

Hi, @JianbangZ. At the moment we have not released the inference code. We intend to release in the nearest future.

havietisov · Answer 2 · Mon Jun 19 2023 22:06:43 GMT+0800 (China Standard Time)

I crave for this inference code.
We crave for this inference code.
EVERYONE crave for this inference code.
Man, please!

evolu8 · Answer 3 · Tue Jun 20 2023 02:05:29 GMT+0800 (China Standard Time)

Yes, looking forward to this inference code release.

Do you need any help with it?

MeJerry215 · Answer 4 · Fri Aug 18 2023 15:04:51 GMT+0800 (China Standard Time)

so where is the inference code? Its about two months.