Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.

https://llamafile.ai

Mozilla-Ocho/llamafile Issues

All Sorts of Issues Executing (WSL and Windows)
Updated 8 days ago7
Segfault from /embedding endpoint
Closed 8 days ago
Compilation error with ROCM: fatal error: 'cmath' file not found
Updated 8 days ago
GPU offloading doesn't seem to be working
Updated 9 days ago7
GGML_ASSERT: ggml-cuda.cu:9198: !"CUDA error"
Updated 9 days ago
Template import/export and defaults
Updated 9 days ago1
More LLava style models: https://github.com/Meituan-AutoML/MobileVLM and https://github.com/vikhyat/moondream
Updated 9 days ago
Signal SIGILL (Illegal Instructions)
Updated 10 days ago
Failed to load model, here's what came out
Updated 10 days ago
Integration with Open WebUI
Updated 11 days ago
Fails to load custom UI on Apple Silicon (M1 Pro) - Shows "File not found" on localhost:8080
Updated 11 days ago
Issue Running llamafile on Ubuntu Server with Dual RTX 3060 GPUs
Updated 12 days ago2
ERROR: UtilGetPpid:1293: Failed to parse
Updated 12 days ago2
Unexpected output from server.cpp `/embedding` endpoint
Closed 12 days ago1
unable run in mac
Closed 13 days ago
example of commandline chat
Updated 14 days ago
ubuntu22.04 make failed!
Updated 15 days ago3
GPU offloading not working on system with AMD 5900HX CPU
Updated 16 days ago2
Feature Request: Option to specify base URL for server mode
Updated 16 days ago
chatml/cml commandline option rejected
Updated 16 days ago
Feature Request: Apple Silicone Neural Engine - Core ML model package format support
Updated 17 days ago
Uncaught SIGSEGV (SEGV_1722) at 0x7ffcc58c53ac
Updated 17 days ago
If the number of words in the answer exceeds the limit, an infinite error will be reported.
Updated 18 days ago
Running llamafile on 2 GPU's instead of 1
Updated 18 days ago
Linux: File does not contain a valid CIL image
Closed 19 days ago3
windows do not run
Updated 18 days ago2
Terminated by signal SIGILL (Illegal instruction)
Updated 19 days ago1
AgentTesla!ml detected on TinyLlama-1.1B-Chat-v1.0.Q5_K_M.llamafile
Updated 19 days ago
Llama 3 chat template
Updated 19 days ago1
CudaMalloc failed: out of memory with TinyLlama-1.1B
Updated 19 days ago4
Uncaught SIGSEGV (SEGV_MAPERR) with Meta-Llama-3-8B-Instruct.Q2_K
Updated 19 days ago
Uncaught SIGSEGV (SEGV_1722) at 0x7ffd45a1cf19
Updated 19 days ago3
wrong endian
Closed 19 days ago2
link_cuda_dso: warning: dlopen() isn't supported on this platform: failed to load library
Closed 19 days ago2
Question
Closed 19 days ago3
Got a trojan warning from windows defender when running phi-2.Q5_K_M.llamafile
Closed 19 days ago2
run-detectors: unable to find an interpreter for ./Meta-Llama-3-8B-Instruct.Q6_K.llamafile
Closed 20 days ago
Run as deamon / background process
Updated 21 days ago1
Error when using -ngl > 0
Updated 22 days ago3
slot unavailable + infinite
Updated 22 days ago
REST API `/heath` is not found
Updated 23 days ago
No Penalize NL not found.
Updated 24 days ago2
Update llama 3 prompt template
Updated 24 days ago2
terminating due to std::out_of_range
Updated 24 days ago
graphical option
Updated 24 days ago1
APE child processes linger around when parent is SIGTERMed
Closed 25 days ago1
Non-AVX execution - SSE-only on Pentiums/Celerons?
Closed a month ago6
Llava-v1.5 llamafile seems to be leaking outputs?
Closed a month ago2
Arm CPU From Ampere Compile and Run Issue
Updated a month ago
Infinite loop of context shift
Updated a month ago