npm / benchmarks

The npm CLI's benchmark suite

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Update pull-request comment generation with threshold

mikemimik opened this issue · comments

Currently, the status in the PR comment just checks if (latest < current) then posts a result based on that. It's not very forgiving. Adding a threshold would be much better to reflect the vary in the results better.

There isn't a way to test this without the code being on master which is an issue. We should create a ticket to create a little testing around this to validate we don't break benchmarking.