nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Questions about package installation of vllm==0.1.4.

AcRush420 opened this issue · comments

When I installed package vllm==0.1.4.
It turned out that"Collecting torch>=2.0.0 (from vllm==0.1.4)"
which didn't meet your environment
conda install pytorch==1.12.0 torchvision==0.13.0 torchaudio==0.12.0 cudatoolkit=11.3 -c pytorch.

The installation process of vllm==0.1.4 automaticly uninstall the old version of pytorch==1.12.0 and install the new version of pytorch.

yes. this would be fine to use torch>=2.0.0.