enable avx and avx2 if supported when GPU doesn't exist
prabirshrestha opened this issue · comments
Prabir Shrestha commented
Noticed that ollama recently added support for avx and avx2 instructions.
Fixed performance issues on Windows without GPU acceleration. Systems with AVX and AVX2 instruction sets should be 2-4x faster.
Kamil Tomšík commented
According to this it might be just adding option to ./src/windows/create_zip.sh
and/or compiling linux with similar flags
Kamil Tomšík commented
Superseded by #23
Kamil Tomšík commented
Closing in favor of #23