mistralai / mistral-inference

Official inference library for Mistral models

Home Page:https://mistral.ai/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

!mistral-demo $7B_DIR issue

shaimaa0000 opened this issue · comments

Hi ,
When I try to run this command '!mistral-demo $7B_DIR', I encounter an issue related to the GPU. Could you please suggest a solution? I am using Google Colab

issue pic

replace 7B_DIR with M7B_DIR at all places
looks like an issue with setting environment variables with numeric character.
faced the same issue on ubuntu 22.04. replacing the variable solved the problem.

Also note that not every GPU will work with the required version of xformers. If you're having a T4 on google colab, maybe try to manually install a lower version of xformers