Giters

mybigday / llama.rn

React Native binding of llama.cpp

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support Android

jhen0409 opened this issue · comments

commented

Not high priority.

It probably easy to support because we implemented the context in cpp/rn-llama.hpp.

We won't try to integrate the CLBlast part for now, because not all Android devices supports OpenCL.

We can look at ggerganov/llama.cpp#2059 / ggerganov/llama.cpp#2039 for a chance to land so we can use the Vulkan backend.