amundsen-io / amundsen

Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.

Home Page:https://www.amundsen.io/amundsen/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Getting error when using sample_glue_loader.py

shashankincedo opened this issue · comments

Getting below error when testing sample_glue_loader.py:

WARNING:databuilder.publisher.elasticsearch_publisher:ElasticsearchPublisher is being deprecated in favor of using SearchMetadatatoElasticasearchTask which publishes ES metadata with mappings compatible with amundsensearch >= 4.0.0
Exception ignored in: <function Driver.del at 0x7ff03a9ecd30>
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/neo4j/_sync/driver.py", line 411, in del
File "/usr/local/lib/python3.10/dist-packages/neo4j/_sync/driver.py", line 456, in close
File "/usr/local/lib/python3.10/dist-packages/neo4j/_sync/io/_pool.py", line 367, in close
File "/usr/local/lib/python3.10/dist-packages/neo4j/_sync/io/_pool.py", line 320, in _close_connections
File "/usr/local/lib/python3.10/dist-packages/neo4j/_sync/io/_bolt.py", line 757, in close
File "/usr/local/lib/python3.10/dist-packages/neo4j/_sync/io/_bolt.py", line 609, in _send_all
File "/usr/local/lib/python3.10/dist-packages/neo4j/_sync/io/_common.py", line 145, in flush
File "/usr/local/lib/python3.10/dist-packages/neo4j/_async_compat/util.py", line 113, in callback
File "/usr/local/lib/python3.10/dist-packages/neo4j/_sync/io/_bolt.py", line 688, in _set_defunct_write
File "/usr/local/lib/python3.10/dist-packages/neo4j/_sync/io/_bolt.py

Below is the environment information:

root@ip-10-131-60-103:/amundsen/amundsen/databuilder/example/scripts# cat /etc/os-release
PRETTY_NAME="Ubuntu 22.04.3 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"
VERSION="22.04.3 LTS (Jammy Jellyfish)"
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=jammy
root@ip-10-131-60-103:/amundsen/amundsen/databuilder/example/scripts# docker --version
Docker version 24.0.5, build ced0996
root@ip-10-131-60-103:/amundsen/amundsen/databuilder/example/scripts# docker-compose --version
docker-compose version 1.29.2, build 5becea4c
root@ip-10-131-60-103:/amundsen/amundsen/databuilder/example/scripts#

Docker-compose file:

version: '3'
services:
neo4j:
image: neo4j:3.5.26
container_name: neo4j_amundsen
environment:
- NEO4J_AUTH=neo4j/testers1
ulimits:
nofile:
soft: 40000
hard: 40000
ports:
- 7474:7474
- 7687:7687
volumes:
- ./example/docker/neo4j/conf:/var/lib/neo4j/conf
- ./example/docker/neo4j/plugins:/var/lib/neo4j/plugins
- ./example/backup:/backup
- neo4j_data:/data
networks:
- amundsennet
elasticsearch:
image: elasticsearch:8.8.1
container_name: es_amundsen
ports:
- 9200:9200
volumes:
- es_data:/usr/share/elasticsearch/data
networks:
- amundsennet
ulimits:
nofile:
soft: 65536
hard: 65536
environment:
- discovery.type=single-node
- xpack.security.enabled=false
amundsensearch:
image: amundsendev/amundsen-search:4.1.1
container_name: amundsensearch
ports:
- 5001:5000
depends_on:
- elasticsearch
networks:
- amundsennet
environment:
- PROXY_ENDPOINT=es_amundsen
command: gunicorn -w 2 --bind :5000 search_service.search_wsgi
amundsenmetadata:
image: amundsendev/amundsen-metadata:3.12.2
container_name: amundsenmetadata
depends_on:
- neo4j
ports:
- 5002:5000
networks:
- amundsennet
environment:
- PROXY_HOST=bolt://neo4j_amundsen
command: gunicorn -w 2 --bind :5000 metadata_service.metadata_wsgi
amundsenfrontend:
image: amundsendev/amundsen-frontend:4.2.0
container_name: amundsenfrontend
depends_on:
- amundsenmetadata
- amundsensearch
ports:
- 5000:5000
networks:
- amundsennet
environment:
- SEARCHSERVICE_BASE=http://amundsensearch:5000
- METADATASERVICE_BASE=http://amundsenmetadata:5000
# Only for easy config-less Quickstart bookmark evalutation. TestConfig extends ordinary LocalConfig by
# defining AUTH_USER_METHOD to a hardcoded dummy user in amundsen_application.tests.test_utils.get_test_user()
# See further docs in https://github.com/amundsen-io/amundsenfrontendlibrary/blob/master/docs/configuration.md#flask
# and https://github.com/amundsen-io/amundsenfrontendlibrary/blob/master/docs/configuration.md#authentication
- FRONTEND_SVC_CONFIG_MODULE_CLASS=amundsen_application.config.TestConfig
command: gunicorn -w 2 --bind :5000 amundsen_application.wsgi

networks:
amundsennet:

volumes:
es_data:
neo4j_data:

Thanks for opening your first issue here!