WordPress / openverse

Openverse is a search engine for openly-licensed media. This monorepo includes all application code.

Home Page:https://openverse.org

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Test S3 inaturalist files are not found in MinIO

krysal opened this issue · comments

Description

The test files for the iNaturalist DAG are no longer loaded into MinIO, and what's more, the inaturalist-open-data bucket isn't part of those created by default. This process may be useful for other work in the future.

# Comma separated list of buckets to create on startup
BUCKETS_TO_CREATE=openverse-catalog,openverse-airflow-logs

Reproduction

  1. just catalog/recreate
  2. Observe the logs of the load_to_s3 container
  3. See the errors.
2024-06-15 14:33:48 /opt/minio/load_to_s3_entrypoint.sh: line 11: AWS_ACCESS_KEY: unbound variable

Or directly observe what is in MinIO through the UI: http://localhost:5011/browser
username: test_key
password: test_secret