Knuckles-Team / genius-chatbot

Chatbot that uses any desired hugging face model or allows for scalable intelligence based on hardware limitations

Genius Chatbot

Version: 1.10.0

Chatbot that uses any hugging face model or OpenAI endpoint.

Local vector store supported with ChromaDB, or connect to a PGVector database

Allows for scalable intelligence tailored for hardware limitations

This repository is actively maintained - Contributions are welcome!

Contribution Opportunities:

• Support more vector databases
• Get list of models to choose from
• Output everything as JSON when selected

Usage:

Short Flag	Long Flag	Description
-h	--help	See Usage
-a	--assimilate	Assimilate knowledge from media provided in directory
	--batch-token	Number of tokens per batch
	--chromadb-directory	Number of chunks to use
	--chunks	Number of chunks to use
-e	--embeddings-model	Embeddings model to use
	--hide-source	Hide source of answer
-j	--json	Export to JSON
	--openai-token	OpenAI Token
	--openai-api	OpenAI API Url
	--pgvector-user	PGVector user
	--pgvector-password	PGVector password
	--pgvector-host	PGVector host
	--pgvector-port	PGVector port
	--pgvector-database	PGVector database
	--pgvector-driver	PGVector driver
-p	--prompt	Prompt for chatbot
	--mute-stream	Mute stream of generation
-m	--model	Copy GPT4All .bin file from the Model Explorer
	--max-token-limit	Maximum token to generate
	--model-directory	Directory to store models locally
	--model-engine	GPT4All LlamaCPP, or OpenAI

Example:

genius-chatbot --assimilate "/directory/of/documents"

genius-chatbot --prompt "What is the 10th digit of Pi?"

genius-chatbot --prompt "Chatbots are cool because they" \
    --model "wizardlm-13b-v1.1-superhot-8k.ggmlv3.q4_0.bin" \
    --model-engine "GPT4All" \
    --assimilate "/directory/of/documents" \
    --json

Installation Instructions:

Install Python Package

Windows Prerequisites:

Visual Studio Code 2022

winget install -e --id Kitware.CMake

Ubuntu Prerequisites:

apt install -y pandoc

python -m pip install genius-chatbot

Repository Owners: