[TorchBench] Performance Signal Detected

[zzp_miracle]

TorchBench CI has detected a performance signal.

Affected Tests:

• eval-cuda-fp32:
  • attention_is_all_you_need_pytorch[disc (latency)] status changed, 4.854 -> TypeError
  • attention_is_all_you_need_pytorch[blade (latency)] status changed, 5.769 -> TypeError
  • attention_is_all_you_need_pytorch[dynamo-blade (latency)] status changed, 6.525 -> TypeError
  • attention_is_all_you_need_pytorch[dynamo-disc (latency)] status changed, 5.521 -> TypeError
  • attention_is_all_you_need_pytorch[disc (compiled)] status changed, 1341.0 -> N/A
  • attention_is_all_you_need_pytorch[disc (clusters)] status changed, 4.0 -> N/A
  • attention_is_all_you_need_pytorch[dynamo-disc (clusters)] status changed, 1.0 -> N/A
  • attention_is_all_you_need_pytorch[dynamo-disc (compiled)] status changed, 1203.0 -> N/A
  • hf_Bert[dynamo-blade (latency)] 7.911 -> 6.949, +12.1603%
  • hf_Bert[dynamo-disc (latency)] 8.191 -> 7.29, +10.9999%
• eval-cuda-fp16:
  • attention_is_all_you_need_pytorch[disc (latency)] status changed, 2.733 -> TypeError
  • attention_is_all_you_need_pytorch[blade (latency)] status changed, 5.9 -> TypeError
  • attention_is_all_you_need_pytorch[dynamo-blade (latency)] status changed, 5.34 -> TypeError
  • attention_is_all_you_need_pytorch[dynamo-disc (latency)] status changed, 3.537 -> TypeError
  • attention_is_all_you_need_pytorch[disc (compiled)] status changed, 1341.0 -> N/A
  • attention_is_all_you_need_pytorch[disc (clusters)] status changed, 4.0 -> N/A
  • attention_is_all_you_need_pytorch[dynamo-disc (clusters)] status changed, 1.0 -> N/A
  • attention_is_all_you_need_pytorch[dynamo-disc (compiled)] status changed, 1203.0 -> N/A
  • hf_Bert[dynamo-blade (latency)] 4.444 -> 3.213, +27.7003%
  • hf_Bert[dynamo-disc (latency)] 4.507 -> 3.346, +25.7599%
  • resnet18[dynamo-blade (latency)] 1.013 -> 0.945, +6.7127%

detail data can be seen in oss://bladedisc-ci/TorchBench/gpu/partial/20230525-15
created by TorchBench CI automatically