airockchip / rknn-llm

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support RK3566?

tolidano opened this issue · comments

commented

I have a few zero-factor rk3566-based devices (radxa zero, radxa zero 3w, geniatech zero).
These have a 1 TOPS NPU vs 6 TOPS in rk3588.
I see that the 3588 has a 6 TOPS NPU which is supported by this repo.
What would it take to try to run these models on the rk3566?
Would it work without changes to try?
Where would I begin if I wanted to try to make it compatible?
I am mostly interested in qwen2:0.5b-instruct or maybe https://huggingface.co/ahxt/LiteLlama-460M-1T if we can get it running.

See: https://gadgetversus.com/processor/rockchip-rk3588-vs-rockchip-rk3566/

Thanks!