add checksum verification for downloaded models
benoitf opened this issue · comments
it looks like when huggingface.co is not working, we download files thinking it worked well but in fact it downloaded a corrupted file
as huggingface.co is providing the checksums for the files, checksum should be added to the ai.json file in the models definition https://github.com/containers/podman-desktop-extension-ai-lab/blob/main/packages/backend/src/assets/ai.json#L110
and we should verify the checksum once downloaded
how to get checksum, just click on the file on huggingface.co
example on https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF/blob/main/mistral-7b-instruct-v0.1.Q4_K_M.gguf
you see
Git LFS Details
SHA256: 14466f9d658bf4a79f96c3f3f22759707c291cac4e62fea625e80c7d32169991