How can I run wasmedge on Windows11 with GGML plugin
zhanghui-china opened this issue · comments
Summary
on ubuntu, I use
wasmedge --dir .:. --nn-preload default:GGML:AUTO:mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf llama-chat.wasm -p mistral-instruct
But on windows 11, when i run the same command line:
wasmedge --dir .:. --nn-preload default:GGML:AUTO:mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf llama-chat.wasm -p mistral-instruct
I've installed wasmedge on windows using "winget install wasmedge"
and i downloaded WasmEdge-plugin-wasi_nn-ggml-0.13.5-darwin_x86_64.tar.gz and decompressed to C:\Program Files\WasmEdge\lib
![3de636ebc23ed4fd570f4703f8292a5](https://private-user-images.githubusercontent.com/63148804/305461569-f57ed0ba-f7fb-4f0f-96b3-a486d39964f1.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjA1ODQ3OTMsIm5iZiI6MTcyMDU4NDQ5MywicGF0aCI6Ii82MzE0ODgwNC8zMDU0NjE1NjktZjU3ZWQwYmEtZjdmYi00ZjBmLTk2YjMtYTQ4NmQzOTk2NGYxLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzEwVDA0MDgxM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTA0OGJmZTc3ZjcxOGYzMWQ4OTk2YmMwZWY0ZmZlNzY0ZDFiNWM3MDg4MmNjNTA2MzllMmI0NGNhM2FkMDcyOTQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.bMGEckdJQP_k5FITKYjedUvWCTixYdoZs5-vrYadnZc)
How can I run wasmedge on Windows in order to chat with LLM?
Appendix
No response
Currently, we don't support the ggml plugin directly on Windows. If you would like to try it, please use the WSL/WSL2 environment instead. Thanks.
ok,3q。