Project-Sustain / sustain-kNN-dataIngestor

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

sustain-kNN-dataInjestor

Primary purpose of this project is to read required query conditions from a property file named config.properties and connect to sustain-dht. Next, extract relevant sketches, format them in required format and save to the MongoDB.

Currently, config.properties file can hold below properties:

  • host=lattice-80.cs.colostate.edu

  • port=9091

  • dataset=noaa_2015_jan

  • geohashes=9x, 9y8b9

  • fromTimestamp=2015-01-01 00:00

  • toTimestamp=2015-01-08 23:59

  • intermediate.output.file=./data/

  • mongodb.host=pierre.cs.colostate.edu

  • mongodb.port=27023

  • mongodb.db=noaadb

  • mongodb.collection=noaa_test1

  • mongodb.shardkey=GeoHash

Adding any new properties will require code changes in sustain.kNN.utility.PropertyLoader class. Further, the values of these properties will be used to populate the query to extract sketches from the storage.

On the other hand, features of extracted sketches should be loaded from a metadata server and use the feature names appropriately in Documents to be stored in MongoDB .

To run this, execute; (make sure config.properties file is in the same directory as the jar) java -jar sustain-kNN-1.0-SNAPSHOT.jar config.properties

About


Languages

Language:Java 100.0%