Directly stream some exports data
grololo06 opened this issue · comments
Present API https://ecotaxa.obs-vlfr.fr/api/redoc#tag/objects/operation/export_object_set only allows to start a background job and get the needed data. So, on client side, it's several steps to get the result: start the job, monitor the job, download the result, extract from the result.
Present issue would allow to get, for summary exports, the data directly as the API call response.
This would allow a simpler interaction, present a datasource for e.g. EcoPart, and allow neat GUI features such as e.g. export preview inside a browser.
Note: Under the condition of good performance. Users should not wait 10 minutes for their data to appear.
@juliecoust if you think about a specific output format feel free to tell.
Presumably, this would only include metadata, not images, right?
JSON itself is not really streamable. Maybe multipart with one JSON for each object (or a batch of objects)?
Then again: With multipart, one could also include images...
Hello, it would be for "summary exports" for the moment, i.e. computations around abundance, concentrations, biovolumes. Pls see recently solved issues on the topic. Indeed it's not really "streaming" as the data volume is quite low.
Ah, ok :)