Giters

WasmEdge / WasmEdge

WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime for cloud native, edge, and decentralized applications. It powers serverless apps, embedded functions, microservices, smart contracts, and IoT devices.

Home Page:https://WasmEdge.org

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

feat: Support WasmEdge and its ggml plugin on Ascend chip

alabulei1 opened this issue · comments

commented

Summary

One of the advantages of using WasmEdge as the LLM inference runtime is that WasmEdge is portable across different CPUs and GPUs. So it's important to support more chips for WasmEdge.

Huawei Ascend chip is a popular AI processor that WasmEdge should support.

Details

Support running LLM inference on Ascend chip

Appendix

No response