compression doesn't seem to work when runner is dataflow
blackknight467 opened this issue · comments
Setting the pipeline option compression to gzip ends up with the loader outputting files in plain text with no compression.
snowplow-incubator / snowplow-google-cloud-storage-loader
Dataflow job to dump the content coming from a PubSub subscription into Cloud storage