play with streaming graphql results
mattkrick opened this issue · comments
probably needs to be a REALLY big json to be a net win, but for something like relay that aggregates queries in 1 HTTP roundtrip, this could get interesting...
https://jakearchibald.com/2016/streams-ftw/
I could see this being very useful for huge geospatial datasets. I'm implementing mapping soon and will definitely attempt to stream the json from rethinkdb.
Is this issue specifically about streaming queries? I don't think we have to worry about subscribe because each document is emitted separately, but we could easily have a large json list of notes. Expecting a few thousand items on each kanban isn't unreasonable.
In my opinion this is worth exploring so we can pass backpressure through to the database, though it probably means going around the official rethinkdb client with something like JSONStream
nah, this is all about client-side streams. keeping the DB and server in physical proximity, it'll probably never be the bottleneck since it dedupes subscription documents before it sends them over the wire. If it is, RethinkDB has some really simple proxying available to reduce the load of a distributed system. I haven't had this problem though so I'm not the best person to ask about it.
just sharing, facebook recent update to subscription in graphql using @LiVe keyword https://www.youtube.com/watch?v=ViXL0YQnioU&feature=youtu.be .
@cometta thanks for sharing! it just so happens subscription support will be my next sprint on https://github.com/mattkrick/cashay. It really is the wild west for real-time updates, so don't be shy if you've got any good patterns you'd like to share!