marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

precompiled rocm and metal wheels

ParisNeo opened this issue · comments

Thank you for this good and cool project.
I was wondering if you could make a metal and rocm wheels and post them on pypi.
This makes install easier since they don't need to recompile if they have rocm or metal device.

pip install ctransformers[cuda]
pip install ctransformers[rocm]
pip install ctransformers[metal]