pacospace / document-sync-job

Sync Thoth documents to an S3 API compatible remote

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Thoth's document-sync-job

Sync Thoth documents to an S3 API compatible remote.

This job makes sure Thoth documents required in deployments are properly copied from one deployment to another. The job is designed for cases when one deployment performs data calculation with ingestion and another is used to serve the computed data.

The job accepts Thoth parameters required to use Thoth's adapters (via environment variables) to obtain data from the first deployment and uses AWS CLI to copy data to the deployment which serves data. Thus the later deployment is configured via the standard AWS CLI configuration file that should be present in ~/.aws/config.

About

Sync Thoth documents to an S3 API compatible remote

License:GNU General Public License v3.0


Languages

Language:Python 100.0%