hiconvo / backups

Manual backups for Google's Datastore. Why don't they have an auto-backups feature? πŸ˜‘

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Convo Backups

These scripts take backups of the Cloud Datastore database, save them to a Cloud Bucket, and export them to BigQuery.

For cloud_datastore_admin.py, which takes the backups, I just followed the instructions here.

For bigquery_import.py, I made some adjustments to the original cloud_datastore_admin.py to get it to import the backups to BigQuery.

bigquery_import.py is dependent on cloud_datastore_admin.py having run on the same calendar day and to have generated the backups that it looks for to export to BigQuery. These backups are expected to be named as parts-YYYY-MM-DD.

The cron.yaml file is in the API repo.

About

Manual backups for Google's Datastore. Why don't they have an auto-backups feature? πŸ˜‘


Languages

Language:Python 100.0%