MiniCodeMonkey / batch-machine

Python scripts to download and process a single source

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

OA Machine

Scripts for performing ETL on a single source, passing the end result to the openaddresses/batch service Uses OpenAddresses data sources to work.

Status

This code is being used to process the complete OA dataset on a weekly and on-demand basis, with output visible at batch.openaddresses.io.

These scripts are wrapped by the main openaddresses/batch processor.

Use

It is highly recommended to use this tool via the provided docker file - using an unsupported/untested version of GDAL (the core geospatial library) will result in widely varying results.

Should you run this in a virtual env, install Tippecanoe and GDAL before use.

Docker

docker build -t batch-machine .
Todo: Add example for running as cli in docker

About

Python scripts to download and process a single source

License:ISC License


Languages

Language:Python 99.8%Language:Dockerfile 0.2%