Giters

ArEnSc / Production-RWKV

This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV branch of code.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

AMD

bennmann opened this issue · comments

commented

If you can give me the step by step timing commands, I can help update your table with AMD 6900 XT data soonish; I already have some RWKV running on AmD.

AMD has come a long way

commented

We did a very course grain calculation we put the timer at the start of the context generation, at the end of it, and then calculated the number of tokens generated per second. This is through the interface too, we didn't even get to the root of the code. Ideally I should write a tiny wrapper to do timing but that's what we did!