Reduce compressed database size
ribbybibby opened this issue · comments
The database is ~160MB compressed. This is bigger than I'd like it to be although it's still smaller than some container images that people are typically happy to pull down to their laptops.
I've already done quite a lot to get the size down but there's probably more that could be done.
I just tested and using zstd with the highest compression level gives a compressed size of ~129MB vs ~170MB for the current db. This is without a noticeable (at least for me) impact on decompression speed.
I made the zstd change. I also recently ran grype and noted that their DB size was 118MB, so that signals to me we're in the ballpark of a size people are willing to accept.
The database size seems acceptable for now. I'm going to close this but its something that should be revisited regularly.