feat(llama.cpp): Vulkan, Kompute, SYCL
mudler opened this issue · comments
Tracker for: ggerganov/llama.cpp#5138 and also ROCm
- Vulkan: #2648 (upstream ggerganov/llama.cpp#2059 )
- Kompute: (upstream ggerganov/llama.cpp#4456 )
- sycl: #1660 ( upstream ggerganov/llama.cpp#2690 )
- ROCm: #1595 (#1100)
The merge requests linked on this issue appears to be merged upstream. Does that mean LocalAI already supports Vulkan or there are any additional tasks to do before that?
The merge requests linked on this issue appears to be merged upstream. Does that mean LocalAI already supports Vulkan or there are any additional tasks to do before that?
Only kompute is missing as for now