WasmEdge / WasmEdge

WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime for cloud native, edge, and decentralized applications. It powers serverless apps, embedded functions, microservices, smart contracts, and IoT devices.

Home Page:https://WasmEdge.org

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

feat: WASI-NN GGML backend show token per second when using `compute_single()`

dm4 opened this issue · comments

commented

Summary

The compute_single() will not print the table to show the performance. Need to print it in fini_single() when log enabled.

Details

TBD

Appendix

No response