0xSecureByte / llama.cpp

LLM inference in C/C++

Repository from Github https://github.com0xSecureByte/llama.cpp

This repository is not active

About

LLM inference in C/C++

MIT License

Languages

Language:C++ 60.3%Language:C 18.1%Language:Python 6.7%Language:Cuda 6.7%Language:Metal 2.6%Language:Objective-C 2.6%Language:CMake 1.2%Language:Shell 0.8%Language:Makefile 0.5%Language:Nix 0.2%Language:Dockerfile 0.2%Language:Batchfile 0.0%Language:JavaScript 0.0%Language:Swift 0.0%