abhishek-ch / VectorVerse

Explore Multiple Vector Databases and chat with documents on Multiple LLM models, private LLM models

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Dockerize the entire project

abhishek-ch opened this issue · comments

Dockerize the entire project will make deployment very easy. Currently the docker build fails due to missing c++ binary

The current issue is stuck with

elastic_transport.ConnectionError: Connection error caused by: ConnectionError(Connection error caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0xffff4a4f04c0>: Failed to establish a new connection: [Errno 111] Connection refused))

Somehow ES and Chroma DB are not able to access the binary. The issue can be due to the multi-stage build where the child stage doesn't copy the binaries from build stage, only site-packages

Error with ChromaDb

vectorverse-streamlit_app-1  |   File "/usr/local/lib/python3.10/site-packages/chromadb/__init__.py", line 35, in Client
vectorverse-streamlit_app-1  |     return system.get_api()
vectorverse-streamlit_app-1  |   File "/usr/local/lib/python3.10/site-packages/chromadb/config.py", line 97, in get_api
vectorverse-streamlit_app-1  |     self.api = self._instantiate("chroma_api_impl")
vectorverse-streamlit_app-1  |   File "/usr/local/lib/python3.10/site-packages/chromadb/config.py", line 87, in _instantiate
vectorverse-streamlit_app-1  |     impl = cls(self)
vectorverse-streamlit_app-1  |   File "/usr/local/lib/python3.10/site-packages/chromadb/api/local.py", line 57, in __init__
vectorverse-streamlit_app-1  |     self._db = system.get_db()
vectorverse-streamlit_app-1  |   File "/usr/local/lib/python3.10/site-packages/chromadb/config.py", line 92, in get_db
vectorverse-streamlit_app-1  |     self.db = self._instantiate("chroma_db_impl")
vectorverse-streamlit_app-1  |   File "/usr/local/lib/python3.10/site-packages/chromadb/config.py", line 85, in _instantiate
vectorverse-streamlit_app-1  |     module = importlib.import_module(module_name)
vectorverse-streamlit_app-1  |   File "/usr/local/lib/python3.10/importlib/__init__.py", line 126, in import_module
vectorverse-streamlit_app-1  |     return _bootstrap._gcd_import(name[level:], package, level)
vectorverse-streamlit_app-1  |   File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
vectorverse-streamlit_app-1  |   File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
vectorverse-streamlit_app-1  |   File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
vectorverse-streamlit_app-1  |   File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
vectorverse-streamlit_app-1  |   File "<frozen importlib._bootstrap_external>", line 883, in exec_module
vectorverse-streamlit_app-1  |   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
vectorverse-streamlit_app-1  |   File "/usr/local/lib/python3.10/site-packages/chromadb/db/duckdb.py", line 4, in <module>
vectorverse-streamlit_app-1  |     from chromadb.db.clickhouse import (
vectorverse-streamlit_app-1  |   File "/usr/local/lib/python3.10/site-packages/chromadb/db/clickhouse.py", line 11, in <module>
vectorverse-streamlit_app-1  |     from chromadb.db.index.hnswlib import Hnswlib, delete_all_indexes
vectorverse-streamlit_app-1  |   File "/usr/local/lib/python3.10/site-packages/chromadb/db/index/hnswlib.py", line 7, in <module>
vectorverse-streamlit_app-1  |     import hnswlib
vectorverse-streamlit_app-1  | ImportError: /usr/lib/aarch64-linux-gnu/libgomp.so.1: cannot allocate memory in static TLS block