Dockerize the entire project
abhishek-ch opened this issue · comments
Abhishek Choudhary commented
Dockerize the entire project will make deployment very easy. Currently the docker build fails due to missing c++ binary
Abhishek Choudhary commented
The current issue is stuck with
elastic_transport.ConnectionError: Connection error caused by: ConnectionError(Connection error caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0xffff4a4f04c0>: Failed to establish a new connection: [Errno 111] Connection refused))
Somehow ES and Chroma DB are not able to access the binary. The issue can be due to the multi-stage build where the child stage doesn't copy the binaries from build stage, only site-packages
Abhishek Choudhary commented
Error with ChromaDb
vectorverse-streamlit_app-1 | File "/usr/local/lib/python3.10/site-packages/chromadb/__init__.py", line 35, in Client
vectorverse-streamlit_app-1 | return system.get_api()
vectorverse-streamlit_app-1 | File "/usr/local/lib/python3.10/site-packages/chromadb/config.py", line 97, in get_api
vectorverse-streamlit_app-1 | self.api = self._instantiate("chroma_api_impl")
vectorverse-streamlit_app-1 | File "/usr/local/lib/python3.10/site-packages/chromadb/config.py", line 87, in _instantiate
vectorverse-streamlit_app-1 | impl = cls(self)
vectorverse-streamlit_app-1 | File "/usr/local/lib/python3.10/site-packages/chromadb/api/local.py", line 57, in __init__
vectorverse-streamlit_app-1 | self._db = system.get_db()
vectorverse-streamlit_app-1 | File "/usr/local/lib/python3.10/site-packages/chromadb/config.py", line 92, in get_db
vectorverse-streamlit_app-1 | self.db = self._instantiate("chroma_db_impl")
vectorverse-streamlit_app-1 | File "/usr/local/lib/python3.10/site-packages/chromadb/config.py", line 85, in _instantiate
vectorverse-streamlit_app-1 | module = importlib.import_module(module_name)
vectorverse-streamlit_app-1 | File "/usr/local/lib/python3.10/importlib/__init__.py", line 126, in import_module
vectorverse-streamlit_app-1 | return _bootstrap._gcd_import(name[level:], package, level)
vectorverse-streamlit_app-1 | File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
vectorverse-streamlit_app-1 | File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
vectorverse-streamlit_app-1 | File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
vectorverse-streamlit_app-1 | File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
vectorverse-streamlit_app-1 | File "<frozen importlib._bootstrap_external>", line 883, in exec_module
vectorverse-streamlit_app-1 | File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
vectorverse-streamlit_app-1 | File "/usr/local/lib/python3.10/site-packages/chromadb/db/duckdb.py", line 4, in <module>
vectorverse-streamlit_app-1 | from chromadb.db.clickhouse import (
vectorverse-streamlit_app-1 | File "/usr/local/lib/python3.10/site-packages/chromadb/db/clickhouse.py", line 11, in <module>
vectorverse-streamlit_app-1 | from chromadb.db.index.hnswlib import Hnswlib, delete_all_indexes
vectorverse-streamlit_app-1 | File "/usr/local/lib/python3.10/site-packages/chromadb/db/index/hnswlib.py", line 7, in <module>
vectorverse-streamlit_app-1 | import hnswlib
vectorverse-streamlit_app-1 | ImportError: /usr/lib/aarch64-linux-gnu/libgomp.so.1: cannot allocate memory in static TLS block