FasterDecoding / REST

REST: Retrieval-Based Speculative Decoding, NAACL 2024

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Cannot install the .whl

hasuoshenyun opened this issue · comments

When I tried to install the .whl, the error occurs, "ERROR: draftretriever-0.1.0-cp39-cp39-manylinux_2_34_x86_64.whl is not a supported wheel on this platform."
My PC is linux 22.04 system.

Hi,
I suppose it may be caused by the discrepancy of Linux version. You could try to build yourself:

  1. install rust:
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
  1. install maturin:
pip3 install maturin==0.12
  1. build from source:
cd DraftRetriever;
maturin build --release --strip -i python3.9; # will produce a .whl file
pip3 install [.whl];

It should take only a few minutes to finish these steps.

If you have any further questions, please feel free to contact me.

Welcome to reopen the issue or open another issue if you have any further questions.