alibaba / BladeDISC

BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[TorchBench] Performance Signal Detected

zzpmiracle opened this issue · comments

TorchBench CI has detected a performance signal.

Affected Tests:

  • eval-cuda-fp32:
    • attention_is_all_you_need_pytorch[dynamo-blade (latency)] 6.525 -> 5.848, +10.3755%
    • attention_is_all_you_need_pytorch[dynamo-disc (latency)] 5.521 -> 4.871, +11.7732%
    • hf_Bert[dynamo-blade (latency)] 7.911 -> 6.8, +14.0437%
    • hf_Bert[dynamo-disc (latency)] 8.191 -> 7.233, +11.6958%
  • eval-cuda-fp16:
    • alexnet[blade (latency)] 3.717 -> 3.922, -5.5152%
    • attention_is_all_you_need_pytorch[dynamo-blade (latency)] 5.34 -> 4.423, +17.1723%
    • attention_is_all_you_need_pytorch[dynamo-disc (latency)] 3.537 -> 2.642, +25.3039%
    • hf_Bert[dynamo-blade (latency)] 4.444 -> 3.207, +27.8353%
    • hf_Bert[dynamo-disc (latency)] 4.507 -> 3.259, +27.6903%
    • resnet18[dynamo-blade (latency)] 1.013 -> 0.923, +8.8845%
    • resnet18[dynamo-disc (latency)] 1.448 -> 1.375, +5.0414%

detail data can be seen in oss://bladedisc-ci/TorchBench/gpu/partial/20230521-16
created by TorchBench CI automatically