planetlabs / gpq

Utility for working with GeoParquet

Home Page:https://planetlabs.github.io/gpq/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Convert: Compression toggle doesn't work?

m-mohr opened this issue · comments

I ran the following commands:

  • gpq convert C:\Dev\rapidai4eo\stac-v1.0\rapidai4eo_v1_source_pf\pf.parquet rapidai4eo_v1_source_pf_snappy.geoparquet
  • gpq convert C:\Dev\rapidai4eo\stac-v1.0\rapidai4eo_v1_source_pf\pf.parquet rapidai4eo_v1_source_pf_snappy.geoparquet --compression="snappy"

The files I get are exactly the same. I suspect both files are gzip compressed and the compression parameter was not taken into account.

Thanks for the report. I noticed the same recently and meant to ticket it. The compression is not taken into account when converting Parquet to GeoParquet, but it is when converting GeoJSON to GeoParquet. There are other issues to work out with the Parquet -> GeoParquet transform (e.g. when going from WKT to WKB, the schema is not updated). This issue can be addressed along with the other transform issues.