SBlachuta

graphrag-local-ollama

Local models support for Microsoft's graphrag using ollama (llama3, mistral, gemma2 phi3)- LLM & Embedding extraction

graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system

WilmerAI

A python application that routes incoming prompts to an LLM by category, and can support a single incoming connection from a front end to many backend connections to LLMs, allowing one AI Assistant to be powered by many models.

SELFGOAL

Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".

LARS

An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.

sglang

SGLang is yet another fast serving framework for large language models and vision language models.

ollama_proxy_server

A proxy server for multiple ollama instances with Key security

PraisonAI

PraisonAI application combines AutoGen and CrewAI or similar frameworks into a low-code solution for building and managing multi-agent LLM systems, focusing on simplicity, customisation, and efficient human-agent collaboration. Chat with your ENTIRE Codebase.

open-webui

User-friendly WebUI for LLMs (Formerly Ollama WebUI)

ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

twinny

The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but completely free and 100% private.

functionary

Chat language model that can use tools and interpret the results

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

aide

LLM shell and document interogator

SWE-agent

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.47% of bugs in the SWE-bench evaluation set and takes just 1 minute to run.

pip-library-etl

This Python package simplifies generating documentation for functions and methods in designated modules or libraries. It enables effortless function call generation from natural language input or existing signatures, and facilitates crafting new ones through the integrated model. Beyond documentation, it seamlessly generates sophisticated SQL too.

bllama

1.58-bit LLaMa model

chatgpt-prompts-for-academic-writing

This list of writing prompts covers a range of topics and tasks, including brainstorming research ideas, improving language and style, conducting literature reviews, and developing research plans.

ollama-grid-search

A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.

MetaGPT

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

generative-ai-workbook

Central repository for all LLM development

gpt_academic

为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

chattr

chatAI4R

chatAI4R: Chat-Based Interactive Artificial Intelligence for R

continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

LocalAgents

These agents work based on any local model. You ask your question and simply indicate the number of agents and experts who will answer it.

GPTFast

Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.

Awesome-Graph-LLM

A collection of AWESOME things about Graph-Related LLMs.

ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, Phi, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, GraphRAG, DeepSpeed, vLLM, FastChat, Axolotl, etc.