infoforcefeed / OlegDB

Enough works to use this in production

Home Page:http://olegdb.org

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Optimization Megaticket

qpfiffer opened this issue · comments

General dumping ground for things that need doing to make Oleg Do the Dew™ faster.

  • AOL is pretty damn slow right now. See ticket.
  • fsync/fflush distinction. I've had problems with fsync not actually writing data to disk, so we have to fsync and fflush. Sometimes many times.
  • Transactions must be written to disk and then read from disk to be commited. This fucking sucks. Redo the AOL file so that it is trivially mmap()-able. This way we can take full advantage of the kernel's caching layer.
  • Re-examine stop-the-world rehashing. Might be a good oppotunity to use Google's JumpConsistentHash as a way to only re-index small parts of the table. This would mean removing Murmur3. I'm open for conversation on this one. #nodeps Edit: Tried this, it was slower.
commented
  • have
  • you
  • heard
  • about
  • check
  • lists

You can use them like this:

  • Privilege