feat: provide new ggml plugin assets without AVX feature
hydai opened this issue · comments
hydai commented
Summary
Some users don't have the AVX hardware feature. To allow them to use the ggml plugin (CPU version), we would like to provide a new set of assets that don't contain any AVX-related ISA.
Details
- Provide the noavx CPU ggml plugin assets.
- Provide a new option to allow users to install the noavx version in the installer.
Appendix
No response