[FEATURE]: Storing values larger than 2 GB
mitar opened this issue · comments
Mitar commented
Have you tried Badger before this proposal? and did not find anything similar?
None
What you wanted to do.
I wanted to set ValueLogFileSize
to 6 GB.
What you actually did.
Called opts.WithValueLogFileSize(6 * 1024 * 1024 * 1024)
.
Why wasn't it great, with examples.
I got error Invalid ValueLogFileSize, must be in range [1MB, 2GB)
.
Additional information.
Could this limit be lifted on 64bit systems? It seems to me that this is just to support mmap on 32 bit systems and there is really no design limitation why not to support larger values? On my system, I have:
$ grep -m1 "address sizes" /proc/cpuinfo
address sizes : 39 bits physical, 48 bits virtual
So a bit less than 2^47 (128 TiB) could be the max limit for mmap on my system.
simon commented
I have the same problem, 2G is too little for me, we need more than 8G
nathanhack commented
Same here