- Download the set of Linked Observation Data that want to transform from http://wiki.knoesis.org/index.php/LinkedSensorData.
- Download the Linked Sensor Data with meta data of stations from http://sonicbanana.cs.wright.edu/knoesis_linkedsensordata.tar.gz.
- Download a release of our tool https://github.com/eugenesiow/lsd-ETL/releases/download/0.1.0/LSD-ETL.zip or clone the repository.
- Configure the
run.shscript in the LSD-ETL directory. Change the parameters accordingly. To find a reference of parameters, you can runjava -jar ETL-0.1.0.jar --help. - Run the
run.shscript in the LSD-ETL directory. You might have tochmod 775 run.shto make it executable. - All required files will be produced in the output directory specified. Now you have a
_rdbmssubdirectory and a_tdbsubdirectory with the database outputs in a RDBMS and triplestore.
usage: LSDTransform [-D <driver>] -I <folder path> [-J <the jdbc string>]
[-M <folder path>] -O <folder path> [-P <password>] [-S <stage
number>] [-U <username>]
-D,--jdbc_driver <driver> the JDBC driver package
-I,--src <folder path> the source folder path
-J,--jdbc_string <the jdbc string> the jdbc path
-M,--metadata_src <folder path> the metadata folder path
-O,--output <folder path> the output folder path
-P,--password <password> the db password
-S,--stage <stage number> runs the particular stage
1.Merge RDF by station
2.Metadata to CSV from RDF
3.Generate Mapping from RDF
4.Add Metadata to Mappings
5.Generate CSV from RDF
6.Load RDBMS
7.Load TDB
-U,--user <username> the db user