gpq convert creates invalid file

Question

gpq convert creates invalid file

m-mohr opened this issue a year ago · comments

I used gpq convert to create a geoparquet file from a parquet file:
gpq convert C:\Dev\rapidai4eo\stac-v1.0\rapidai4eo_v1_source_pf\pf.parquet rapidai4eo_v1_source_pf_snappy.geoparquet --compression="snappy"
Afterwards, I ran gpq validate on it and the new file is invalid.
It is missing the geoparquet version number (empty string).

v0.11.0 on Windows 10

Matthias Mohr · Answer 1 · Thu Jul 13 2023 21:24:23 GMT+0800 (China Standard Time)

I don't really understand Go, but I suspect that maybe above https://github.com/planetlabs/gpq/blob/main/internal/geoparquet/geoparquet.go#L404 the Version number must be set?

Tim Schaub · Answer 2 · Mon Sep 25 2023 05:27:16 GMT+0800 (China Standard Time)

@m-mohr - this should be fixed now, but I'd like to validate it before cutting a release. Do you happen to have that C:\Dev\rapidai4eo\stac-v1.0\rapidai4eo_v1_source_pf\pf.parquet file around so I could test it?

Matthias Mohr · Answer 3 · Tue Sep 26 2023 02:37:11 GMT+0800 (China Standard Time)

Thanks, Tim! I don't think I have it anymore, but I can also only check once I'm back from the STAC sprint, i.e. next week Wed. So maybe just go ahead with the release?!

Tim Schaub · Answer 4 · Mon Oct 02 2023 04:04:42 GMT+0800 (China Standard Time)

This should be fixed in the latest release. Please reopen if you find an issue.