Benchmarks: add Automerge v2
mweidner037 opened this issue · comments
Automerge v1 has different (though not strictly better) performance than Automerge v0. It would be nice to benchmark both.
It's easy to install both versions with npm: https://stackoverflow.com/a/56495651/16782898
but I can't figure out how to get it to work with TypeScript. If I try aliasing the packages to "automerge0" and "automerge1", and do import Automerge from "automerge0";, it says File '<repo dir>/node_modules/automerge1/@types/automerge/index.d.ts' is not a module. I'm guessing it is confused by the fact that Automerge's type declarations use the form declare module automerge but the package isn't named "automerge" anymore.
I'm sticking with Automerge v0 for now since v1 gives wrong answers on the todo-list benchmark. (edit: I believe I was using it wrong; it's been updated to 1.0.1-preview.7)
Now v2
Should also make sure Yjs is up-to-date.
#247 updates to the latest versions of @automerge/automerge (2.0.2) and Yjs (13.5.52). However, Automerge is still showing "old" performance (100+ seconds for RealText, instead of <10 seconds). I've asked about it here: automerge/automerge#431 (comment)