OPERA-SDS-VnV_19: Ingest Dynamic Ancillary Data
LucaCinquini opened this issue · comments
Verification activity:
"Demonstrate that the PCM system can successfully retrieve and ingest dynamic ancillary files needed for PGE execution."
Note: this ticket could be combined with OPERA-SDS-VnV_18 once we decide what is a static vs a dynamic ancillary file.
Suggest approach:
o Use the AWS console to navigate to the S3 buckets where the 3 categories of ancillary files are stored: DEMs, Land Cover, and World Cover. Verify that these files are complete (by checking the expected total size) and of the desired version (how?)
Question: are these buckets different for DEV, I&T and Ops? Or are the buckets shared across venues?
o Use the on-demand UI to trigger one (or more) jobs. Wait for the PGE job to start and complete. Look at the job log to verify that the PGE has extracted the 3 categories of ancillary files for the geographic region of interest
(Question: ask PGE team if this information is in-fact stored in the log)
Static data: downloaded only once to the OPERA system
Dynamic data: pulled continuously from an external system
Note: this activity should be retired - at lease for Release 1.