meinside / llamafile-tools

Scripts and tools for generating and using Llamafiles

llamafile-tools

My tools and scripts for generating & using Llamafiles.

• hf2llamafile.sh: generates a llamafile with given HuggingFace model id

• gguf2llamafile.sh: generates a llamafile with an existing .gguf file

• helper scripts (with the help of generated llamafiles)

  • answer.sh: answers given text
  • summarize.sh: summarizes given text

---

References

• https://dev.to/timesurgelabs/llamafile-ai-integration-deployment-made-easy-44cg
• https://www.substratus.ai/blog/converting-hf-model-gguf-model/
• https://justine.lol/oneliners/