rustformers / llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

Home Page:https://docs.rs/llm/latest/llm/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Question: GPU support

toastxc opened this issue · comments

Does llm have CUDA support, if so are there any examples of getting it working?