pubkey / event-reduce

An algorithm to optimize database queries that run multiple times https://pubkey.github.io/event-reduce/

Home Page:https://pubkey.github.io/event-reduce

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Pretty cool

mitar opened this issue · comments

commented

This is really cool. It reminds me of https://github.com/mit-pdos/noria a bit.

@mitar Thank you for posting this, I didn't know noria. Before creating event-reduce I checked for over two years if something similar already exists but could not find any reuseable implementation. So strange that I never stumpled over the hasura live queries docs.

I think the big difference between event-reduce and materialized views is the cost at write time and how it scales. If you have many users all observing different queries, you cannot create so many views because it would break your server on writes.

commented

Yes, I am collecting a list of related projects here.

I think the big difference between event-reduce and materialized views is the cost at write time and how it scales. If you have many users all observing different queries, you cannot create so many views because it would break your server on writes.

I think this really depends how it is implemented. I think incremental materialized view maintenance is very similar to what you have in event reduce, no? See more information about that in current attempt to add that to PostgreSQL. But maybe I am misunderstanding it.

Maybe I am misunderstanding it.
Nice list you have there, give me some time to suck up the information.

Closing this, I have read all the other sources. I think all of these solve slightly different problems but let's see what the future brings.