WasmEdge / WasmEdge

WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime for cloud native, edge, and decentralized applications. It powers serverless apps, embedded functions, microservices, smart contracts, and IoT devices.

Home Page:https://WasmEdge.org

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

feat: Support `--main-gpu` in the ggml plugin

hydai opened this issue · comments

Summary

When using the ggml plugin in a multiple-GPU machine, it's important to specify the main GPU. The default value is using GPU 0 now.

Details

Appendix

No response