Is the fully connected layer faster than using the OpenBLAS equivalent?

Question

Is the fully connected layer faster than using the OpenBLAS equivalent?

RuABraun opened this issue 5 years ago · comments

Rudolf A. Braun · Answer 1 · Wed Nov 13 2019 23:57:03 GMT+0800 (China Standard Time)

No it's a lot slower unfortunately when the input/output has multiple rows. Only a bit faster for the single row case. Probably should just use Arm ComputeLibrary.

Marat Dukhan · Answer 2 · Thu Nov 14 2019 02:06:41 GMT+0800 (China Standard Time)

I suggest you take a look at XNNPACK library, which is a successor to NNPACK.

Rudolf A. Braun · Answer 3 · Thu Nov 14 2019 02:12:25 GMT+0800 (China Standard Time)

Oh nice! Great I'll try it out. :)