cpu-inference

There are 0 repository under cpu-inference topic.

kennethleungty / Llama-2-Open-Source-LLM-CPU-Inference
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
cpu cpu-inference deep-learning faiss langchain large-language-models llm machine-learning natural-language-processing nlp python sentence-transformers transformers c-transformers open-source-llm chatgpt document-qa language-models llama llama-2
Language:Python 933
CoderLSF / fast-llama
Runs LLaMA with Extremely HIGH speed
cpu-inference inference-engine llama llama2
Language:C++ 74
rbitr / llm.f90
LLM inference in Fortran
ai chatbot cpu-inference language-model llama llama2 llamacpp llm mamba phi-2 state-space-model transformer
Language:Fortran 50
homelab
jozsefszalma / homelab
The bare metal in my basement
ai bare-metal cpu-inference hardware-hacking hobby-project homelab machine-learning deep-learning gpu server
10
yybit / pllm
Portable LLM - A rust library for LLM inference
llm cpu-inference llama2 aigc
Language:Rust 9
laelhalawani / gguf_llama
Wrapper for simplified use of Llama2 GGUF quantized models.
cpu-inference gguf llama llama2 llamacpp quantization
Language:Python 5
codito / arey
Simple large language model playground app
ai cli cpu-inference gguf large-language-models llama2 llamacpp llm local-model mistral ollama
Language:Python 2
chinese-soup / cbot-telegram-whisper
Simple bot that transcribes Telegram voice messages. Powered by go-telegram-bot-api & whisper.cpp Go bindings.
bot golang openai whisper whisper-cpp whispercpp cpu-inference speech-recognition speech-to-text
Language:Go 0