Giters

nasa / opera-sds-int

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

OPERA-SDS-VnV-12: Verify the generation rate for the L3_DSWX_HLS product

LucaCinquini opened this issue · comments

commented
OPERA-SDS-VnV-12: Verify the generation rate for the L3_DSWX_HLS product
commented
  • VnV Activity Description

Demonstrate that the OPERA SDS is capable of generating L3_DSWX_HLS data products at 1.5 times the rate required for FWD processing, since this might be needed for "catch-up" operations. Involves querying CMR for a higher nunber of products than expected in FWD mode, and verifying that the SDS system can automatically scale the worker nodes to meet the higher processing demand.

  • VnV Activity Details

Have the system process jobs from the last 36 hours, and show that they complete within 24 hours.

  1. Get the PCM running from a clean state (redeploy, or clear appropriate queues/caches/DBs)
  2. Have the PCM query CMR for input granules covering the previous 36 hours.
  3. Allow the system to process the data and generate output products. Show that all products finish within 24 hours of starting the test.
commented
  1. Trigger the script only once to query for data in the past 36 hours using the "On Demand" UI
commented

Question: how does the system effectively catch up after it has been down for a certain amount of time?