ReBenchDB records benchmark results and provides customizable reporting to track and analyze run-time performance of software programs. It is used for example to track the performance of multiple language implementations, including SOMns and other implementations from the family of Simple Object Machines. ReBench is currently the main benchmark runner to record data for ReBenchDB.
ReBenchDB is designed to
- record benchmark measurements
- [-] information about the environment in which the benchmarks were executed
- [-] enable performance tracking over time
- enable performance comparison of experiments
- [-] supports custom reports and performance analyses
- [-] enables data export
(Things marked with [x] are already finished, or partially finished [-])
ReBenchDB isn't
- a benchmark runner or benchmarking framework: Check ReBench if you need one
- a statistics library: We currently use R for our statistic needs, but anything outputting HTML would be suitable.
ReBenchDB is implemented in TypeScript on top of Node.js. Data is stored in a PostgreSQL database. Custom reports are executed via a shell script, though, we use R to create reports.
TODO: write a detailed description on what is required to set things up.
In case you encounter issues, please feel free to open an issue so that we can help.
For contributions, we use the GitHub flow of pull requests, discussion, and revisions. For larger contributions, it is likely useful to discuss them upfront in an issue first.
Codespeed "is a web application to monitor and analyze the performance of your code." We used it for almost 10 years before starting ReBenchDB. As such it provided a lot of inspiration and at this point, is a more mature and proven alternative.