[TorchBench] Performance Signal Detected
zzpmiracle opened this issue · comments
zzp_miracle commented
TorchBench CI has detected a performance signal.
Affected Tests:
- eval-cuda-fp32:
- attention_is_all_you_need_pytorch[dynamo-blade (latency)] 6.525 -> 5.848, +10.3755%
- attention_is_all_you_need_pytorch[dynamo-disc (latency)] 5.521 -> 4.871, +11.7732%
- hf_Bert[dynamo-blade (latency)] 7.911 -> 6.8, +14.0437%
- hf_Bert[dynamo-disc (latency)] 8.191 -> 7.233, +11.6958%
- eval-cuda-fp16:
- alexnet[blade (latency)] 3.717 -> 3.922, -5.5152%
- attention_is_all_you_need_pytorch[dynamo-blade (latency)] 5.34 -> 4.423, +17.1723%
- attention_is_all_you_need_pytorch[dynamo-disc (latency)] 3.537 -> 2.642, +25.3039%
- hf_Bert[dynamo-blade (latency)] 4.444 -> 3.207, +27.8353%
- hf_Bert[dynamo-disc (latency)] 4.507 -> 3.259, +27.6903%
- resnet18[dynamo-blade (latency)] 1.013 -> 0.923, +8.8845%
- resnet18[dynamo-disc (latency)] 1.448 -> 1.375, +5.0414%
detail data can be seen in oss://bladedisc-ci/TorchBench/gpu/partial/20230521-16
created by TorchBench CI automatically