Run smoke test for R2 RC10 on INT-FWD
philipjyoon opened this issue · comments
Make sure to set ASG max of all cnn send job queues to be 0. ASF is not yet ready to receive our products.
The scripts I created to automate most of this isn't immune to version and script changes in artifactory. Redesigning it right now so that this will be more re-useable.
Smoke test granule submitted for processing. Will take about 2 hrs for it to complete. After that validation script will be run against the resulting product to complete this smoke test.
Script modification is complete. Waiting on the pcm to finish to test the modifications and then complete the test.
Getting the following error when running https://artifactory-fn.jpl.nasa.gov/ui/repos/tree/General/general-stage/gov/nasa/jpl/opera/sds/pcm/testdata_R2.0.0/cslc_compare_results_calval_0.4.0.sh
usage: validate_cslc_product_calval_0.4.0.py [-h] [-r REF_PRODUCT]
[-s SEC_PRODUCT]
[-p {CSLC,static_layers}]
validate_cslc_product_calval_0.4.0.py: error: argument -s/--sec-product: expected one argument
Actually this is not really an error. I was trying running it on empty folder to test for something else. The above issue is moot.
CSLC smoke test comparison all passed with message like the following for all granules:
Comparing results for t064_135518_iw1 ./output_dir_cslc/OPERA_L2_CSLC-S1_T064-135518-IW1_20220501T015035Z_20230818T184249Z_S1A_VV_v0.1/OPERA_L2_CSLC-S1_T064-135518-IW1_20220501T015035Z_20230818T184249Z_S1A_VV_v0.1.h5 ./deployment_smoke_test_cslc_s1_calval_0.4.0/expected_output_data/OPERA_L2_CSLC-S1_T064-135518-IW1_20220501T015035Z_20230809T172935Z_S1A_VV_v0.1/OPERA_L2_CSLC-S1_T064-135518-IW1_20220501T015035Z_20230809T172935Z_S1A_VV_v0.1.h5 Comparing CSLC projection ... Comparing geo transform arrays ... Comparing raster arrays... All CSLC product checks have passed All CSLC metadata checks have passed
Still waiting on RTC to complete.
Having issue with https://artifactory-fn.jpl.nasa.gov:443/artifactory/general-stage/gov/nasa/jpl/opera/sds/pcm/testdata_R2.0.0/rtc_compare_results_calval_0.4.1.sh
The file pattern must be changed. Debugging
Figured it out. The python script now expects folders instead of list of files. So the shell script needs to be changed:
output_file=output_dir_rtc/${burst_id_pattern}
expected_file=deployment_smoke_test_rtc_s1_calval_0.4.1/expected_output_data/${burst_id_pattern}
It seems that the scripts change every RC so it's hard to automate this process. And we're spending too much time debugging the scripts to perform smoke test, which isn't even part of the smoke test.
RTC smoke test passed with output like the following for all granules:
`-------------------------------------
Comparing results for t064_135527_iw1
OPERA_L2_RTC-S1_T064-135527-IW1_*
file_list (directory 1): ['deployment_smoke_test_rtc_s1_calval_0.4.1/expected_output_data/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4_mask.tif', 'deployment_smoke_test_rtc_s1_calval_0.4.1/expected_output_data/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4_VH.tif', 'deployment_smoke_test_rtc_s1_calval_0.4.1/expected_output_data/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4_VV.tif', 'deployment_smoke_test_rtc_s1_calval_0.4.1/expected_output_data/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4.h5']
file_list (directory 2): ['output_dir_rtc/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4_mask.tif', 'output_dir_rtc/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4_VH.tif', 'output_dir_rtc/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4_VV.tif', 'output_dir_rtc/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4.h5']
************* TESTING (GeoTIFF file) **************
*** file 1: deployment_smoke_test_rtc_s1_calval_0.4.1/expected_output_data/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4_mask.tif
*** file 2: output_dir_rtc/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4_mask.tif
/export/home/hysdsops/conda/lib/python3.9/site-packages/osgeo/gdal.py:287: FutureWarning: Neither gdal.UseExceptions() nor gdal.DontUseExceptions() has been explicitly called. In GDAL 4.0, exceptions will be enabled by default.
warnings.warn(
[PASS] Comparing number of bands
Comparing RTC-S1 bands...
[PASS] Band 1 - Mask Layer"
[PASS] Comparing geotransform
[PASS] Comparing metadata
************* TESTING (GeoTIFF file) **************
*** file 1: deployment_smoke_test_rtc_s1_calval_0.4.1/expected_output_data/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4_VH.tif
*** file 2: output_dir_rtc/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4_VH.tif
[PASS] Comparing number of bands
Comparing RTC-S1 bands...
[PASS] Band 1 - RTC-S1 VH Backscatter"
[PASS] Comparing geotransform
[PASS] Comparing metadata
************* TESTING (GeoTIFF file) **************
*** file 1: deployment_smoke_test_rtc_s1_calval_0.4.1/expected_output_data/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4_VV.tif
*** file 2: output_dir_rtc/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4_VV.tif
[PASS] Comparing number of bands
Comparing RTC-S1 bands...
[PASS] Band 1 - RTC-S1 VV Backscatter"
[PASS] Comparing geotransform
[PASS] Comparing metadata
************ TESTING (HDF5 file) ************
*** file 1: deployment_smoke_test_rtc_s1_calval_0.4.1/expected_output_data/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4.h5
*** file 2: output_dir_rtc/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4/OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230818T184250Z_S1A_30_v0.4.h5
Checking the dataset.
[PASS] Dataset 1 of 93: //identification/productSpecificationVersion
[PASS] Dataset 3 of 93: //metadata/sourceData/slantRangeStart
[PASS] Dataset 4 of 93: //identification/lookDirection
[PASS] Dataset 5 of 93: //metadata/sourceData/azimuthLooks
[PASS] Dataset 6 of 93: //metadata/sourceData/zeroDopplerEndTime
[PASS] Dataset 8 of 93: //identification/ceosAnalysisReadyDataProductType
[PASS] Dataset 9 of 93: //identification/institution
[PASS] Dataset 10 of 93: //metadata/orbit/time
[PASS] Dataset 11 of 93: //identification/isGeocoded
[PASS] Dataset 12 of 93: //metadata/sourceData/numberOfAcquisitions
[PASS] Dataset 13 of 93: //identification/radarBand
[PASS] Dataset 14 of 93: //metadata/sourceData/zeroDopplerTimeSpacing
[PASS] Dataset 15 of 93: //metadata/sourceData/numberOfRangeSamples
[PASS] Dataset 16 of 93: //metadata/processingInformation/algorithms/radiometricTerrainCorrection
[PASS] Dataset 17 of 93: //metadata/processingInformation/parameters/radiometricTerrainCorrectionApplied
[PASS] Dataset 18 of 93: //metadata/sourceData/rangeBandwidth
[PASS] Dataset 19 of 93: //metadata/sourceData/softwareVersion
[PASS] Dataset 20 of 93: //metadata/processingInformation/parameters/outputBackscatterDecibelConversionEquation
[PASS] Dataset 21 of 93: //identification/platform
[PASS] Dataset 22 of 93: //identification/boundingPolygon
[PASS] Dataset 23 of 93: //identification/diagnosticModeFlag
[PASS] Dataset 24 of 93: //identification/zeroDopplerEndTime
[PASS] Dataset 25 of 93: //identification/acquisitionMode
[PASS] Dataset 26 of 93: //metadata/processingInformation/algorithms/radiometricTerrainCorrectionAlgorithmReference
[PASS] Dataset 27 of 93: //metadata/processingInformation/algorithms/softwareVersion
[PASS] Dataset 28 of 93: //identification/beamID
[PASS] Dataset 29 of 93: //metadata/sourceData/slantRangeSpacing
[PASS] Dataset 31 of 93: //metadata/sourceData/processingCenter
[PASS] Dataset 32 of 93: //data/yCoordinates
[PASS] Dataset 34 of 93: //identification/processingType
[PASS] Dataset 36 of 93: //identification/absoluteOrbitNumber
[PASS] Dataset 37 of 93: //metadata/processingInformation/algorithms/demInterpolation
[PASS] Dataset 38 of 93: //metadata/processingInformation/parameters/geocoding/ceosAnalysisReadyDataPixelCoordinateConvention
[PASS] Dataset 39 of 93: //metadata/orbit/referenceEpoch
[PASS] Dataset 40 of 93: //identification/project
[PASS] Dataset 41 of 93: //metadata/processingInformation/parameters/wetTroposphericGeolocationCorrectionApplied
[PASS] Dataset 42 of 93: //identification/orbitPassDirection
[PASS] Dataset 44 of 93: //metadata/processingInformation/algorithms/demEgmModel
[PASS] Dataset 45 of 93: //metadata/processingInformation/algorithms/geocoding
[PASS] Dataset 46 of 93: //metadata/sourceData/numberOfAzimuthLines
[PASS] Dataset 47 of 93: //metadata/orbit/position
[PASS] Dataset 48 of 93: //identification/ceosAnalysisReadyDataDocumentIdentifier
[PASS] Dataset 49 of 93: //metadata/sourceData/azimuthResolutionInMeters
[PASS] Dataset 50 of 93: //metadata/processingInformation/parameters/geocoding/burstGeogridSnapX
[PASS] Dataset 51 of 93: //metadata/sourceData/institution
[PASS] Dataset 52 of 93: //metadata/processingInformation/parameters/inputBackscatterNormalizationConvention
[PASS] Dataset 53 of 93: //metadata/sourceData/zeroDopplerStartTime
[PASS] Dataset 54 of 93: //identification/productLevel
[PASS] Dataset 55 of 93: //metadata/orbit/interpMethod
[PASS] Dataset 56 of 93: //metadata/processingInformation/inputs/l1SlcGranules
[PASS] Dataset 57 of 93: //metadata/processingInformation/parameters/geocoding/burstGeogridSnapY
[PASS] Dataset 58 of 93: //metadata/sourceData/productLevel
[PASS] Dataset 60 of 93: //metadata/processingInformation/parameters/filteringApplied
[PASS] Dataset 61 of 93: //metadata/processingInformation/parameters/bistaticDelayCorrectionApplied
[PASS] Dataset 62 of 93: //data/listOfPolarizations
[PASS] Dataset 63 of 93: //metadata/processingInformation/parameters/noiseCorrectionApplied
[PASS] Dataset 64 of 93: //identification/burstID
[PASS] Dataset 65 of 93: //metadata/sourceData/nearRangeIncidenceAngle
[PASS] Dataset 66 of 93: //data/yCoordinateSpacing
[PASS] Dataset 67 of 93: //identification/productType
[PASS] Dataset 68 of 93: //identification/zeroDopplerStartTime
[PASS] Dataset 69 of 93: //metadata/sourceData/maxNoiseEquivalentSigmaZero
[PASS] Dataset 70 of 93: //identification/boundingBox
[PASS] Dataset 71 of 93: //identification/instrumentName
[PASS] Dataset 72 of 93: //metadata/processingInformation/algorithms/geocodingAlgorithmReference
[PASS] Dataset 73 of 93: //metadata/sourceData/slantRangeLooks
[PASS] Dataset 74 of 93: //metadata/sourceData/centerFrequency
[PASS] Dataset 75 of 93: //metadata/sourceData/slantRangeResolutionInMeters
[PASS] Dataset 76 of 93: //data/projection
[PASS] Dataset 77 of 93: //identification/trackNumber
[PASS] Dataset 78 of 93: //metadata/QA/rfiInformation/isRfiInfoAvailable
[PASS] Dataset 79 of 93: //metadata/sourceData/dataAccess
[PASS] Dataset 80 of 93: //identification/productVersion
[PASS] Dataset 81 of 93: //metadata/processingInformation/parameters/preprocessingMultilookingApplied
[PASS] Dataset 82 of 93: //data/xCoordinateSpacing
[PASS] Dataset 83 of 93: //metadata/processingInformation/parameters/dryTroposphericGeolocationCorrectionApplied
[PASS] Dataset 84 of 93: //metadata/sourceData/farRangeIncidenceAngle
[PASS] Dataset 85 of 93: //metadata/processingInformation/parameters/outputBackscatterExpressionConvention
[PASS] Dataset 86 of 93: //metadata/processingInformation/parameters/outputBackscatterNormalizationConvention
[PASS] Dataset 87 of 93: //metadata/orbit/velocity
[PASS] Dataset 89 of 93: //metadata/processingInformation/algorithms/noiseCorrectionAlgorithmReference
[PASS] Dataset 90 of 93: //metadata/orbit/orbitType
[PASS] Dataset 91 of 93: //data/xCoordinates
[PASS] Dataset 92 of 93: //identification/dataAccess
[PASS] Dataset 93 of 93: //metadata/sourceData/processingDateTime
Checking the attributes.
HDF5 test summary:
[PASS] Same dataset structure confirmed.
[PASS] Same attributes structure confirmed.
[PASS] The datasets of the two HDF files are the same within the tolerance.
Relative tolerance = 0.001, Absolute tolerance = 0.0001
[PASS] The attributes of the two HDF files are the same within the tolerance
Relative tolerance = 0.001, Absolute tolerance = 0.0001
************ Overall results ************
[PASS] file: OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4_mask.tif
[PASS] file: OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4_VH.tif
[PASS] file: OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4_VV.tif
[PASS] file: OPERA_L2_RTC-S1_T064-135527-IW1_20220501T015059Z_20230809T172938Z_S1A_30_v0.4.h5
*******************************************************`