Implement statistics caching
ryanrolds opened this issue · comments
Is your feature request related to a problem? Please describe.
Calculating medians in real-time doesn't scale. It's likely that switching to average would help, but aggregating a lot of the submissions table with each map and explorer load won't be performant when the submissions tables have several million records.
Describe the solution you'd like
Implement a cache table that will hold pre-computed statistics for all boundaries and key filter permutations.
For more details on the goal see: https://paper.dropbox.com/doc/SpeedUpAmerica-Filters--Af8QhXvoREyMrqn9x5Wer6MgAg-VsVINVN8wCs0mmUZGOLhb
This is done.