rustformers / llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

Home Page:https://docs.rs/llm/latest/llm/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Invalid magic number while loading LoRAs

clarkmcc opened this issue · comments

I'm getting the following error when trying to load a LoRA.

InvalidMagic { path: "~/.chitchat/loras/alpaca-lora-7b.bin", magic: 4034b50 (PK) }

Is this because the LoRA is out of date, or is our ggml implementation out of date? I get the same error across 3-4 different LoRAs.

LoRA files should always start with the ggla magic. (See here) Could you link to the LoRA file you were using? And could it be that you did use a pytorch file without converting it first?

I agree with Lukas - is it possible that you're using unconverted LoRAs? (Yes, it's rather confusing - we hope the situation will get better soon!)