compressed json

[Alejandro Giacometti]

looks like datafusion just shipped the ability to read compressed data – such as gziped json
apache/datafusion#3642 (review)

[Tim Van Wassenhove]

It would be awesome to have some test which verifies that this works

[Alejandro Giacometti]

I tried it today, but I'm not sure how to tell qv that it should use json as the file type.

qv "s3://path/to/bucket/*.json.gz"
Error: Internal("Unable to infer file type from suffix gz")

[Alejandro Giacometti]

🤘