Query caching for "sticky" scenes (plots, text logs...)
teh-cmc opened this issue · comments
Currently, querying a sticky scene is O(n), and as time goes on it gets more and more laggy.
This is already an issue for plots and text logs today.
Ideally, one would want to cache the results of a query up to now(), and then only query the difference the next frame, and so on and so on.
Problem is: what about out of order data?
Also applies to the visible_history feature as a whole, and very much relates to #1331
Screenshot from one of our users hitting this in the wild:
Even without caching I wonder if we can do better than 4µs/get
We're finally getting started on this now, though a fix will not likely land before December 2023.
- Fixed by #4853