preciz / crash

This crashes something somewhere

crash - This llama.cpp setup crashes something somewhere

Steps

Build docker image

git clone https://www.github.com/preciz/crash
cd crash
wget 'https://huggingface.co/TheBloke/Llama-2-7B-GGML/resolve/main/llama-2-7b.ggmlv3.q4_K_M.bin'
docker build . -t embedding

Install Elixir for the stress test scripts:

pacman -S elixir

Run the stress test

elixir start.exs

About

This crashes something somewhere

MIT License

Languages

Language:C 49.3%Language:C++ 21.8%Language:Cuda 13.5%Language:Metal 4.0%Language:Python 3.5%Language:Objective-C 3.1%Language:Shell 2.0%Language:CMake 1.4%Language:Makefile 0.8%Language:Zig 0.3%Language:Nix 0.2%Language:Dockerfile 0.1%Language:Elixir 0.1%Language:Swift 0.0%