Implement default (console) manifest
blackvvine opened this issue · comments
BigQuery, GCS, Cloud Monitoring and Firebase all have downsides and set up overhead and are unfit to be the default option for the manifest.
A manifest that periodically dumps the download progress and status to console (which would in turn show up in Cloud Logging for Dataflow jobs) has the benefit of zero set up overhead (IAM or configurations), and should be the default option.