eodcgmbh / drbx-cortex-topic-ers-1-2

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

The DRBX Cortex Topic Definition for ERS-1/2

Introduction.

The topic definition is a Java package that allows identifying ERS-1/2 products by applying regular expressions-like file name matching rules. The central element of this package is the ontology definition file (cortex-index.owl) located in the META-INF folder inside the resources directory.

The topic is currently designed to support the following product types from the ERS-1/2 satellite mission:

  • ASPS products (AMI sensor)
    • ASPS20.H
    • ASPS20.N
  • ATSR sensor
    • AT1_AR__2P
    • AT1_NR__2P
    • AT1_TOA_1P
    • AT2_AR__2P
    • AT2_TOA_1P
    • AT2_NR__2P
  • RA sensor
    • ERS_ALT_2_
    • ERS_ALT_2M
    • ERS_ALT_2S

For decoding the binary datasets, which is necessary for extracting metadata and the footprint coordinates, product-specific XML schema definitions are contained in the (xsd) folder inside the resources directory. Where available, the metadata information is extracted from the netCDF file.

The file name matching patterns and the XSD files were created based on the official product specification documents:

Apache Maven is used for building the Java project. The Project Object Model XML file (pom.xml) specifies the overall package configuration.

Product Format and Composition

ASPS Products

The considered products from the AMI sensor (ASPS) are provided in the netCDF format, i.e. one file per dataset:

  • one netCDF file having the extension .nc

Examples for these products include:

  • ASPS20_H_931113133451.nc
  • ASPS20_N_980922033121.nc

No compression is applied in this case and the netCDF files are ingested directly into DHuS.

Metadata and footprints are created based on the information contained within the netCDF file.

ATSR Sensor

The ATSR products are comprised of three or four physical files, which are delivered separately:

  • a mixed ASCII/BINARY data file having the extension .E1 for ERS-1 and .E2 for ERS-2
  • a log file containing processing logs with the extension .log
  • an md5 checksum file having the extension .md5
  • for TOA products additionally a text file having the extension .OT

Metadata is extracted from the E1/E2 ASCII header, footprints are created based on the records contained within the E1/E2 binary section.

In order for the DHuS ingest to work, these two individual files need to be combined into one ZIP archive first. The filename of the archive needs to be exactly the same as for the other files, with the obvious difference of having the file extension ".zip".

The following is an example illustrating the structure for the ATSR products, after the previous step of ZIP archive creation:

  • AT1_AR__2PURAL19951118_174642_000000008008_00183_22716_0000.zip
    • AT1_AR__2PURAL19951118_174642_000000008008_00183_22716_0000.E1
    • AT1_AR__2PURAL19951118_174642_000000008008_00183_22716_0000.E1.log
    • AT1_AR__2PURAL19951118_174642_000000008008_00183_22716_0000.E1.md5

Note that the file that will be ingested in DHuS is the AT1_AR__2PURAL19951118_174642_000000008008_00183_22716_0000.zip.

RA Sensor

The considered products from the RA sensor (REAPER) are provided in the netCDF format, i.e. one file per dataset:

  • one netCDF file having the extension .NC

Examples for these products include:

  • E1_REAP_ERS_ALT_2M_19950810T165017_19950810T182941_RP01.NC
  • E2_REAP_ERS_ALT_2__19950515T161633_19950515T175536_RP01.NC
  • E2_REAP_ERS_ALT_2S_19950515T112228_19950515T130053_RP01.NC

No compression is applied in this case and the netCDF files are ingested directly into DHuS.

Metadata and footprints are created based on the information contained within the netCDF file.

Defined Classes for ERS-1/2

Class &ers12;productASPS

The &ers12;productASPS class identifies the ASPS products from the AMI sensor based on file name matching rules. The expected format is netCDF. This class must match the corresponding ASPS class name referenced by the metadata extractor in the ERS-1/2 addon (separate Java package).

Class &ers12;productATSR

The &ers12;productATSR class identifies the ERS-1/2 ATSR products. This class must match the corresponding class name referenced by the metadata extractor in the ERS-1/2 addon (separate Java package). It is the base class for all ATSR products.

Class &ers12;productATSR_zip

The &ers12;productATSR_zip is a subclass of &ers12;productATSR and identifies the zipped ERS-1/2 ATSR products.

Class &ers12;productATS_AR__2P

The &ers12;productATS_AR__2P is a subclass of &ers12;productATSR and identifies the ATS_AR__2P product E1 or E2 file. It also references the corresponding XML schema file.

Class &ers12;productATS_NR__2P

The &ers12;productATS_NR__2P is a subclass of &ers12;productATSR and identifies the ATS_NR__2P product E1 or E2 file. It also references the corresponding XML schema file.

Class &ers12;productATS_TOA_1P

The &ers12;productATS_TOA_1P is a subclass of &ers12;productATSR and identifies the ATS_TOA_1P product E1 or E2 file. It also references the corresponding XML schema file.

Class &ers12;productRA

The &ers12;productRA class identifies the REAPER products from the RA sensor based on file name matching rules. The expected format is netCDF. This class must match the corresponding RA class name referenced by the metadata extractor in the ERS-1/2 addon (separate Java package).

About

License:GNU Affero General Public License v3.0