PromtEngineer / localGPT

Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

PromtEngineer/localGPT Issues

Support llama-3
Updated 16 days ago4
I encountered a mistake when I executed run_localGPT_API.py
Updated 18 days ago1
run_localGPT_API
Updated 18 days ago1
Not using the GPU
Updated 20 days ago8
Docker not using GPU
Updated a month ago1
error in /opt/nvidia/nvidia_entrypoint.sh
Updated a month ago
Docker not building: ModuleNotFoundError: No module named 'utils'
Updated a month ago1
Mistral not supported
Updated a month ago2
Extra Options with run_localGPT_API.py?
Updated a month ago
cpp-llama-python not found.
Updated a month ago1
auto-gptq and auto awq is breaking in requiremetns.txt
Updated a month ago
is it possible to use a previously downloaded HF .gguf file
Closed a month ago3
problem when ingesting (just CPU)
Updated a month ago
Unable to load llama model from path
Updated a month ago2
Requested tokens exceed context window of 4096
Updated 2 months ago3
No module named 'triton'
Updated 2 months ago9
How to make LocalGPT to translate everything into English language before store and process inputs
Updated 2 months ago2
Download the source document
Updated 2 months ago1
"TypeError: 'HuggingFaceInstructEmbeddings' object is not callable" after enter a query
Updated 2 months ago8
Question: How to run UI from Docker?
Updated 2 months ago1
Hugging Faces Down: Unable to run models that have already been downloaded.
Updated 2 months ago4
While executing "ingest.py" I am getting below error
Updated 2 months ago4
[Question] Can you help me, please? 100k PDFs!
Updated 2 months ago3
Autoawq
Closed 2 months ago2
INSTRUCTOR._load_sbert_model() got an unexpected keyword argument 'token'
Closed 4 months ago6
How do I add memory to chat-zero-shot-react-description?
Updated 2 months ago
Why its sharing questions and data from different browser sessions?
Updated 2 months ago
use_history in API
Closed 2 months ago1
Could the project support the lastest model Gemma which has much higher performance than LLAMA2?
Updated 2 months ago1
UI is a blank web page
Closed 2 months ago4
Getting error when I try to python ingest.py
Updated 2 months ago
Can localGPT support Chinese?
Closed 3 months ago5
Wrong answer
Updated 3 months ago
Error when starting python ingest.py
Updated 3 months ago1
Your GPU is probably not used at all, which would explain the slow speed in answering.
Updated 3 months ago1
AttributeError: 'LlamaRotaryEmbedding' object has no attribute 'cos_cached'. Did you mean: 'sin_cached'?
Updated 3 months ago7
name 'compute_device' is not defined when --device_type cpu on Linux
Closed 3 months ago6
KeyError: 'Cache only has 0 layers, attempted to access layer with index 0 - TheBloke/WizardLM-30B-Uncensored-GPTQ
Updated 3 months ago
KeyError: 'Cache only has 0 layers, attempted to access layer with index 0'
Updated 3 months ago3
[macOs] ingest.py: IndexError: list index out of range
Updated 3 months ago1
Docker Build no module named 'utils'
Updated 3 months ago3
Exllama kernel does not support query
Updated 3 months ago
GPU layers/batch size/models selction
Updated 3 months ago
Local Gpt
Closed 3 months ago
No module named click
Closed 3 months ago1
multi-user or async prompt requests crashes the app
Updated 4 months ago6
Ingestion Error / Batch processing
Updated 4 months ago2
When using mistral tokenizer, the system role cannot be used
Closed 4 months ago
run_localGPT.py fail: python run_localGPT.py --device_type cpu
Updated 4 months ago
Suggestion to improve or fine tune the model with custom documents
Updated 4 months ago1