Is navigating/transforming messagepack data possible?
simonasGit opened this issue · comments
I am looking to use msgpack for storage kind of like Firefox saves bookmarks in JSON. I've decided to go with msgpack because it's self-describing which I need as the structure of my data store is going to be ever changing.
I've come to like JQ for navigating JSON and performing operations like merge, accessing a particular property within a field, transforming data, etc.
How can I achieve this functionality with msgpack?
My data store is going to have binary data in it so converting it to JSON → modifying it → marshalling back to MP is not ideal.
As far as I know, AVRO allows for data projections (reading of individual fields out of each record), but it requires a schema to be explicitly defined.
Stumbled across RION which looks promising, is self-describing and is designed to be used directly in its binary form. As for now, implementations/tooling for it pretty much doesn't exist.
Realized I wrote nonsense, sorry for wasting your time. Have a good day.