localllama

There are 1 repository under localllama topic.

sozercan / kubectl-ai
✨ Kubectl plugin to create manifests with LLMs
ai chatgpt gpt gpt-4 hacktoberfest k8s kubectl kubectl-plugins kubernetes llm localllama open-llm openai openai-api
Language:Go 1018
awaescher / OllamaSharp
The easiest way to use the Ollama API in .NET
llm ollama ollama-api llama ai gemma2 gpt llamacpp localllama mistralai streaming hacktoberfest
Language:C# 433
moritztng / fltr
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
llm rust llama llama-2 localllama mistral mixtral mixtral-8x7b cli grep operating-system grep-like
Language:Rust 373
aikit
sozercan / aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
ai buildkit chatgpt docker fine-tuning finetuning gemma gpt inference kubernetes large-language-models llama llm localllama mistral mixtral nvidia open-llm open-source-llm openai
Language:Go 365
SqueezeAILab / KVQuant
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
compression efficient-inference efficient-model large-language-models llama llm localllama localllm mistral model-compression natural-language-processing quantization small-models text-generation transformer
Language:Python 284
aub.ai
BrutalCoding / aub.ai
AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
android dart flutter gemini gemini-nano gen-ai genai indiedev ios ipados linux llamacpp localllama macos mistral-7b native-apps nlp on-device on-device-ai pubdev
Language:Dart 206
wordflow
poloclub / wordflow
Social and customizable AI writing assistant! ✍️
ai gemini gemini-pro gpt gpt-4 llama2 llm localllama mlc prompt-engineering writing-assistant
Language:TypeScript 181
Belluxx / LlamaTerm
Use your open source local model from the terminal
llama3-meta-ai llm-inference local-llama localllama qwen2
Language:Python 8
seyf1elislam / LocalLLM_OneClick_Colab
Run gguf LLM models in Latest Version TextGen-webui
colab-notebook exllama gguf gptq llm llms localllama localllm python
Language:Jupyter Notebook 6
awaescher / OllamaSharpConsole
Full featured demo application for OllamaSharp
ai localllama ollama ollama-api ollama-app ollama-client ollama-gui ollama-ui ollamasharp
Language:C# 5
knilink / tamperpilot
A tool allows to customize and enhance the functionality of local copilot editor plugins.
codecompletion copilot llamacpp localllama ollama
Language:JavaScript 1
OleksiiHorishnii / tldr-email-summarizer
Summarize emails received by Thunderbird mail client extension via locally run LLM. Early development.
localllama
Language:Python 0
av1d / LAISer
Local AI Search assistant web or CLI for ollama and llama.cpp. Lightweight and easy to run, providing a Perplexity-like experience.
ai cli localllama localllm search-algorithm search-engine
Language:Python