msgpack / msgpack

MessagePack is an extremely efficient object serialization library. It's like JSON, but very fast and small.

Home Page:http://msgpack.org/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Is navigating/transforming messagepack data possible?

simonasGit opened this issue · comments

I am looking to use msgpack for storage kind of like Firefox saves bookmarks in JSON. I've decided to go with msgpack because it's self-describing which I need as the structure of my data store is going to be ever changing.

I've come to like JQ for navigating JSON and performing operations like merge, accessing a particular property within a field, transforming data, etc.
How can I achieve this functionality with msgpack?
My data store is going to have binary data in it so converting it to JSON → modifying it → marshalling back to MP is not ideal.

As far as I know, AVRO allows for data projections (reading of individual fields out of each record), but it requires a schema to be explicitly defined.

Stumbled across RION which looks promising, is self-describing and is designed to be used directly in its binary form. As for now, implementations/tooling for it pretty much doesn't exist.

Realized I wrote nonsense, sorry for wasting your time. Have a good day.