nomic-ai / gpt4all

gpt4all: run open-source LLMs anywhere

Home Page:https://gpt4all.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

v2.7.5 Windows Local and Server Model both use Llama 3 Instruct, program crash

davidngrc opened this issue · comments

I am on Windows 10 Pro.
with NVidia P40, 24G RAM
Newly download GPT4ALL v2.7.5,
only download one model: Llama 3 Instruct

steps

  1. I use curl to query the model in server mode, works.
  2. then I switch to local client, and manually load the only one download model "Llama 3 Instruct".
  3. after the model loaded, like at 99.9%, the program crash, and exe exit.

the problem also exists before v2.7.5
this problem also occur when use other model, or multiple models.
does not matter if you load the local model or server mode load the model first, all crash.

please help fix.
thank you

Duplicate of #2205