kalisio / krawler

A minimalist (geospatial) ETL

https://kalisio.github.io/krawler/

kalisio/krawler Issues

Refactor CI to use GitHub actions and generic bash scripts
Closed 2 months ago
Add a hook to read sequential GeoJson
Closed 3 months ago
Add hooks to create/drop indices in MongoDB
Closed 5 months ago
Add utility functions to insert hooks in hook definitions object
Closed 5 months ago
Add an option to skip writing task data if it already exists
Closed 6 months ago
Migrate docs to vitepress
Closed 9 months ago
callFeathersServiceMethod hook raises a single error on multi-operations
Closed a year ago
callFeathersServiceMethod hook with create method omit data on error
Closed a year ago1
createMongoCollection hook does not wait for indices to be created
Closed a year ago
Allow to define content response for a status code
Closed a year ago
Allow conversion to a different case in transformJson hook
Closed a year ago
Allow conversion to a different radix in transformJson hook
Closed a year ago
Task must not be in error if the response code is a successful code
Closed a year ago2
String conversion does not work in unit mapping for transformJson hook
Closed a year ago
callFeathersServiceMethod hook does not work for patch/update with data as item payload
Closed a year ago
callFeathersServiceMethod overwrite null id
Closed a year ago
Transform options erased in readCSV hook
Closed a year ago
Rely on Papaparse to implement CSV hooks
Closed a year ago1
Handle ObjectID in mongo query
Closed a year ago
Default overpass server does not work anymore
Closed a year ago
FTP tests do not work on CI
Updated a year ago1
getFTP hook should remove the localfile before getting the remote file
Closed a year ago
Allow to disable automated type conversion when templating a query
Closed a year ago
Conversion not applied when a templated query contains an array
Closed a year ago
Make docker image run with node user
Closed a year ago
connectMongo handles hook keyword as an option
Closed a year ago
Allow pipeline to be templated in createMongoAggregation hook
Closed a year ago
Create a hook to run a task
Closed a year ago
Support post method for http tasks
Closed a year ago
Improve basic auth hook to support storing a cookie
Closed a year ago
Improve basic auth hook to support sending form data
Closed a year ago
Improve basic auth hook to support token request
Closed a year ago
Tests relying on Meteo France API do not work anymore
Closed a year ago
Add a hook to specify outputs of a task
Closed 2 years ago
Feathers hooks should be able to use distributed services
Closed 2 years ago
Add params option to Feathers service method hook
Closed 2 years ago
Hook to call a Feathers API should allow to transform data before sending
Closed 2 years ago1
Krawler API mode does not work anymore
Closed 2 years ago
Job without tasks exit as failing
Closed 2 years ago
Allow to read KML files
Closed 2 years ago
Allow to read TXT files
Closed 2 years ago
Add hooks to use a Feathers API
Closed 2 years ago
Tasks order in job result array
Closed 2 years ago1
Ensure the store path exists when creating a store of type of FS
Closed 2 years ago
Provide a envsubst hook
Closed 2 years ago
Provide a globFTP hook
Closed 2 years ago
Allow to specify Xml2js parsing options
Closed 2 years ago
Refactor FTP hooks using lftp
Closed 2 years ago
Reflect healthcheck status in exit code
Closed 2 years ago
Add a hook to check for existing key in store
Closed 2 years ago