ushahidi / grimlock

A simple transformation/data processing pipeline for CrisisNET

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Grimlock

"Me, Grimlock."

A simple transformation/data processing pipeline for CrisisNET. Pulls jobs from a FIFO queue and runs each through a series of predefined tasks. These tasks add metadata to content retrieved by Sucka.

New tasks can be added to the tasks package, and included in the pipeline in app.set_pipeline_steps.

Very much a work in progress. Watch this space.

About

A simple transformation/data processing pipeline for CrisisNET


Languages

Language:Python 55.3%Language:JavaScript 31.4%Language:CSS 9.4%Language:Shell 3.8%