naklecha / llama3-from-scratch

llama3 implementation one matrix multiplication at a time

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support hf format model,suffix with safetensors

ZiQiangXie opened this issue · comments

Very interesting work. Thank you so much.
I've implemented a repo that supports the weights of the huggingface format on this basis. if anyone is interested, you can refer to it.
https://github.com/ZiQiangXie/llm-from-scratch