How easy it is to externalize the visibility of the benchmarks we already run continuously?
bhack opened this issue · comments
This a pinpoint to not lost the benchmarking subthread started at tensorflow/tensorflow#33945 (comment)
Quoting @zongweiz
We have [TF2 benchmarks] (https://github.com/tensorflow/models/tree/master/official/benchmark) from every official model garden model and they continuously running internally, using PerfZero framework. We should be able to select a set of benchmarks and hook it up with github CI (jenkins). Added @sganeshb to this thread for information and we will follow up.
Another thought is to start CI tests using a selected set of tf_benchmarks
Is it ok to track this here?