mixtral

There are 1 repository under mixtral topic.

h2oai / h2ogpt
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/
ai chatgpt embeddings generative gpt gpt4all llama2 llm mixtral pdf private privategpt vectorstore
Language:Python 11155
bigscience-workshop / petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
bloom deep-learning distributed-systems language-models large-language-models machine-learning neural-networks pytorch volunteer-computing pipeline-parallelism tensor-parallelism guanaco llama chatbot gpt transformer nlp pretrained-models falcon mixtral
Language:Python 9036
yangjianxin1 / Firefly
Firefly: 大模型训练工具，支持训练Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
gpt alpaca llm baichuan llama lora qlora peft llama2 internlm chatglm qwen aquila mistral mixtral zephyr minicpm gemma llama3 qwen2
Language:Python 5545
InternLM / xtuner
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
baichuan chatglm2 internlm large-language-models llama2 llm llm-training peft qwen chatbot conversational-ai supervised-finetuning agent chatglm3 msagent llava mixtral llama3 phi3
Language:Python 3621
aandrew-me / tgpt
AI Chatbots in terminal without needing API keys
ai chatbot chatgpt cli go golang gpt3 linux llama macos mixtral terminal windows
Language:Go 1799
elia
darrenburns / elia
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
ai chatgpt claude gemma gpt large-language-models llama llama3 llm mistral mistral-ai mixtral ollama ollama-client ollama-interface phi-3 python terminal tui
Language:Python 1712
Ollamac
kevinhermawan / Ollamac
Mac app for Ollama
ai llm llma llma2 llms ollama mistral macos llama3 mixtral
Language:Swift 1153
ymcui / Chinese-Mixtral
中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）
32k 64k large-language-models llm mixtral mixture-of-experts moe nlp
Language:Python 571
jianzhnie / LLamaTuner
Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
chatgpt dpo llama llama3 mixtral ppo qlora qwen rlhf
Language:Python 556
moritztng / fltr
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
llm rust llama llama-2 localllama mistral mixtral mixtral-8x7b cli grep operating-system grep-like
Language:Rust 371
tenstorrent / tt-metal
:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
accelerator falcon llama llm low-level-programming metal mistral mixtral ml resnet stable-diffusion tenstorrent
Language:C++ 366
aikit
sozercan / aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
buildkit large-language-models llm docker inference kubernetes nvidia ai llama chatgpt localllama open-source-llm mistral mixtral gpt openai fine-tuning finetuning gemma open-llm
Language:Go 346
helixml / helix
Multi-node production AI stack. Run the best of open source AI easily on your own servers. Create your own AI by fine-tuning open source models. Integrate LLMs with APIs. Run gptscript securely on the server
golang llama llm mistral openai self-hosted mixtral sdxl stable-diffusion api finetuning function-calling llm-agent llm-serving openapi rag swagger helm k8s gptscript
Language:Go 297
WangRongsheng / Aurora
🐳 Aurora is a [Chinese Version] MoE model. Aurora is a further work based on Mixtral-8x7B, which activates the chat capability of the model's Chinese open domain.
mixtral-8x7b-instruct mixtral mixtral-8x7b instruction-tuning lora qlora fine-tuning large-language-models llm gpt language-model chinese
Language:Python 257
inferflow / inferflow
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
llama2 llamacpp llm-inference model-quantization multi-gpu-inference mixture-of-experts moe gemma falcon minicpm mistral bloom deepseek internlm phi-2 baichuan2 mixtral m2m100 qwen
Language:C++ 232
empower-functions
empower-ai / empower-functions
GPT-4 level function calling models for real-world tool using use cases
ai function-calling llama3 llm mixtral
Language:Python 181
ollama-ai
gbaptista / ollama-ai
A Ruby gem for interacting with Ollama's API that allows you to run open source AI LLMs (Large Language Models) locally.
ai alpaca bakllava dolphin llama llama2 llava llm mistral mistral-ai mixtral nano-bots ollama ollama-api openorca vicuna
Language:Ruby 166
expectedparrot / edsl
Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.
anthropic data-labeling deepinfra domain-specific-language experiments llama2 llm llm-agent llm-framework llm-inference market-research mixtral open-source openai python social-science surveys synthetic-data
Language:Python 161
machinascript-for-robots
babycommando / machinascript-for-robots
Build LLM-powered robots in your garage with MachinaScript For Robots!
ai arduino artificial-intelligence gpt gpt-3 gpt-4 llama llama2 llm llms mistral mistral-7b mixtral mixtral-8x7b raspberry-pi raspberry-pi-4 robot robotics robots
Language:Python 157
unifyai / unify
A Python package for LLM dynamic routing through the Unify REST API.
ai claude gpt gpt-4 llama2 llm llm-inference llms mixtral openai python
Language:Python 155
Picovoice / picollm
On-device LLM Inference Powered by X-Bit Quantization
llm compression efficient-inference gemma generative-ai language-model language-models large-language-model llama llama2 llama3 llms mistral mixtral model-compression natural-language-processing quantization self-hosted llm-inference
Language:Python 151
noco-ai / spellbook-docker
AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models
automatic-speech-recognition bark llama2 llm-inference mixtral musicgeneration stable-diffusion text-to-speech whisper xttsv2
Language:Shell 131
vemonet / libre-chat
🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup. Powered by LangChain.
chatbot chatgpt langchain large-language-models llama2 llm llm-inference mixtral no-code open-source openapi question-answering self-hosted
Language:Python 125
marklysze / LlamaIndex-RAG-WSL-CUDA
Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
llama-2 llamaindex mistral-7b orca-2 retrieval-augmented-generation yi-34b windows-10 windows-11 wsl2 mixtral mixtral-8x7b phi-2 microsoft-phi-2 neural-7b neural-chat-7b gemma gemma-2b gemma-7b
Language:Jupyter Notebook 117
trinib / ZORG-Jailbreak-Prompt-Text
Bypass restricted and censored content on AI chat prompts 😈
ai ai-chatbot chatbot chatgpt huggingface mistral mixtral jailbreak openai prompt ai-chat-bot chat-box jailbreak-prompt gpt-3-5-turbo gpt
74
herc.ai
Bes-js / herc.ai
A powerful library for interacting with the Herc.ai API.
ai api chatbot chatgpt chatgpt-api gpt gpt-4 bard bard-ai bing bing-api chatgpt4 dall-e dalle gemini openai mixtral
Language:JavaScript 63
ad-si / cai
The fastest CLI tool for prompting LLMs. Including support for prompting several LLMs at once!
ai anthropic chatgpt claude cli gpt gpt-4 gpt-4o groq llama llama3 llamafile llm mistral mixtral ml ollama openai prompt rust
Language:Rust 49
fly-apps / ollama-open-webui
Self-host a ChatGPT-style web interface for Ollama 🦙
gpu ollama ollama-webui llama3 mixtral gemma llava mistral ai
Language:Shell 46
Dublit-Development / ollama-api
Deploy a RESTful API Server to interact with Ollama and Stable Diffusion
ai llama2 machine-learning mistral-7b ollama serverless stable-diffusion codellama codellama-70b-instruct mixtral
Language:Python 43
Mobile-Artificial-Intelligence / maid_llm
maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
facebook flutter-ai gemma ggml gguf llama llama2 llamacpp llm llm-inference local-ai meta mistral mixtral mobile-ai
Language:Dart 37
ventz / easy-llms
Easy "1-line" calling of all LLMs from OpenAI, MS Azure, AWS Bedrock, GCP Vertex, and Ollama
ai21 amazon-titan aws azure azure-openai bedrock claude claude-3 cohere gemini-pro google google-vertex-ai langchain langchain-python llama3 llms mistral mixtral ollama openai
Language:Python 37
marklysze / LangChain-RAG-Linux
Examples of RAG using LangChain with local LLMs - Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
langchain linux llama-2 microsoft-phi-2 mistral-7b mixtral mixtral-8x7b neural-7b neural-chat-7b ollama orca-2 phi-2 rag retrieval-augmented-generation yi-34b
Language:Jupyter Notebook 30
hkproj / mistral-src-commented
Reference implementation of Mistral AI 7B v0.1 model.
llm mistral mistral-7b mixtral mixtral-8x7b nlp pytorch
Language:Python 25
robertZaufall / mindmanager_ai
MindManager Automation and AI Integration on Windows and macOS
applescript appscript azure-ai claude3 gpt4 groq macos macros mermaid mindjet mindmanager mindmap mistral mixtral ollama openai python refinement vba wwb
Language:Python 25
tghamm / Mistral.SDK
An unofficial C#/.NET SDK for accessing the Mistral AI API
c-sharp csharp dotnet dotnet-core dotnet-standard machine-learning mistral mistral-7b mistralai ml sdk mixtral mixtral-8x7b
Language:C# 23
hkproj / mistral-llm-notes
Notes on the Mistral AI model
llm mistral mistral-7b mixtral mixtral-8x7b nlp pytorch xformers sliding-window-attention
Language:Jupyter Notebook 17