gusye1234 / WasmEdge-WASINN-examples

WasmEdge WASI-NN Examples

High-level bindings for writing wasi-nn applications

Introduction

This project provides the examples of high-level wasi-nn bindings on Rust programming language. Developers can refer to this project to write their machine learning application in a high-level language using the bindings, compile it to WebAssembly, and run it with a WebAssembly runtime that supports the wasi-nn proposal, such as WasmEdge.

NOTE: These bindings are experimental (use at your own risk) and subject to upstream changes in the wasi-nn specification.

Prerequisites

OpenVINO Installation

Developers should install the OpenVINO first before build and run WasmEdge with wasi-nn and the examples. For this project, we use the version 2021.4.582. Please refer to the installation script.

curl -sSL https://apt.repos.intel.com/openvino/2021/GPG-PUB-KEY-INTEL-OPENVINO-2021 | sudo gpg --dearmor > /usr/share/keyrings/GPG-PUB-KEY-INTEL-OPENVINO-2021.gpg
echo "deb [signed-by=/usr/share/keyrings/GPG-PUB-KEY-INTEL-OPENVINO-2021.gpg] https://apt.repos.intel.com/openvino/2021 all main" | sudo tee /etc/apt/sources.list.d/intel-openvino-2021.list
sudo apt update
sudo apt install -y intel-openvino-runtime-ubuntu20-2021.4.582

After the installation, you may need to add the path:

source /opt/intel/openvino_2021/bin/setupvars.sh
sudo ldconfig

Rust Installation

Please refer to the Rust Official Site for the Rust installation. After the installation, developers should add the wasm32-wasi target.

rustup target add wasm32-wasi

Download the wasi-nn Rust Crate

In Rust, download the crate from crates.io by adding wasi-nn = "0.1" as a Cargo dependency.

Build the WasmEdge with WASI-NN supporting

For running the examples, developers should build WasmEdge from source. First developers should get the source:

git clone https://github.com/WasmEdge/WasmEdge.git
cd WasmEdge

And build with the WASMEDGE_PLUGIN_WASI_NN_BACKEND argument:

cmake -Bbuild -GNinja -WASMEDGE_PLUGIN_WASI_NN_BACKEND="OpenVINO" .
cmake --build build
# For the WASI-NN plugin, you should install this project.
cmake --install build

After the installation, developers can execute the wasmedge executable with WASI-NN plugin.

Notice: If you didn't install the project, you should give the WASMEDGE_PLUGIN_PATH environment variable for specifying the WASI-NN plugin path (the built plugin is at build/plugins/wasi_nn).

Examples

Mobilenet

Related Links

• WASI
• wasi-nn
• WasmEdge
• wasi-nn-guest

License

This project is licensed under the Apache 2.0 license. See LICENSE for more details.

Contribution

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in this project by you, as defined in the Apache-2.0 license, shall be licensed as above, without any additional terms or conditions.