kalisio / k-awc

Krawler based jobs to download data Aviation Weather Center

k-awc

A Krawler based service to download METAR and TAF data from the Aviation Weather Center.

Description

The k-awc jobs allow to scrape data using the api provided by the Avioation Weather Center.

The downloaded data are stored within a MongoDB database and more precisely in 3 collections:

• awc-metars that stores the METAR data
• awc-tafs that stores the TAF data
• awc-stations that stores the stations data

All records are stored in GeoJson format.

The job is executed according a specific cron expression. By default, every hours.

Implementation

As far as possible, jobs use the cache files.

Configuration

stations

Variable	Description
DB_URL	The mongoDB database URL. The default value is mongodb://127.0.0.1:27017/awc
DEBUG	Enables debug output. Set it to krawler* to enable full output. By default it is undefined.

metars

Variable	Description
DB_URL	The mongoDB database URL. The default value is mongodb://127.0.0.1:27017/awc
TTL	The data time to live. It must be expressed in seconds and the default value is 2592000 (30 days)
DEBUG	Enables debug output. Set it to krawler* to enable full output. By default it is undefined.

Deployment

We personally use Kargo to deploy the service.

Contributing

Please refer to contribution section for more details.

Authors

This project is sponsored by

License

This project is licensed under the MIT License - see the license file for details