amundsen-io / amundsen

Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.

Home Page:https://www.amundsen.io/amundsen/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

sample_data_loader_neptune.py - No data loaded in Neptune

vle1 opened this issue · comments

commented

I am trying to set up Amundsen with Neptune backend. I've configured Neptune and AWS Elasticsearch and launched the Amundsen services through the bootstrap docker-compose example.

The sample data loader completes without error. I see files written to S3 and data written to ES, search also works on the Amundsen frontend, however there does not seem to be any data written to Neptune and loading the homepage or any table page (from search results) fails with HTTP 500 errors.

I have set up all the IAM trust relationships and I'm running the script from an EC2 within the same VPC and am assuming the role created for Neptune/S3/ES full access.

Checking status in Neptune via Sagemaker Jupyter notebook shows status healthy

{'status': 'healthy',
 'startTime': 'Thu Jan 26 23:37:02 UTC 2023',
 'dbEngineVersion': '1.2.0.1.R2',
 'role': 'writer',
 'dfeQueryEngine': 'viaQueryHint',
 'gremlin': {'version': 'tinkerpop-3.5.2'},
 'sparql': {'version': 'sparql-1.1'},
 'opencypher': {'version': 'Neptune-9.0.20190305-1.0'},
 'labMode': {'ObjectIndex': 'disabled',
  'ReadWriteConflictDetection': 'enabled'},
 'features': {'ResultCache': {'status': 'disabled'},
  'IAMAuthentication': 'enabled',
  'Streams': 'disabled',
  'AuditLog': 'disabled'},
 'settings': {'clusterQueryTimeoutInMs': '120000'}}

Running sparql query to view any graphs in Neptune shows nothing

%%sparql

SELECT DISTINCT ?g 
WHERE {
  GRAPH ?g { ?s ?p ?o }
}
{
  "head": {
    "vars": [
      "g"
    ]
  },
  "results": {
    "bindings": []
  }
}

logs.txt

Thanks for opening your first issue here!

commented

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

commented

This issue has been automatically closed for inactivity. If you still wish to make these changes, please open a new pull request or reopen this one.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.