Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.

Home Page:https://llamafile.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Got a trojan warning from windows defender when running phi-2.Q5_K_M.llamafile

ugthefluffster opened this issue · comments

Immediately upon running the file as an .exe, windows shut it down and warned of Trojan:Win32/Sabsik.FL.A!ml

We currently only offer Windows Defender support for the binaries on the llamafile releases page: https://github.com/Mozilla-Ocho/llamafile/releases/ since llamafiles on HF are usually larger than what Microsoft's analysis form accepts. What you can do to solve this issue, is you can download llamafile-0.8 and then say .\llamafile-0.8.exe -m phi-2.Q5_K_M.llamafile -p hello to use the weights you've already downloaded as just a data file. Sorry this happened to you. I'll do some closer analysis too, to see what's going wrong with the phi-2 llamafiles, since they're smaller than most models.

I checked and phi-2.Q5_K_M.llamafile comes up clean when I scan it with Windows Defender. Try updating your malware definitions.

  1. Open command prompt as administrator and change directory to c:\Program Files\Windows Defender
  2. Run “MpCmdRun.exe -removedefinitions -dynamicsignatures”
  3. Run "MpCmdRun.exe -SignatureUpdate"