alibaba / BladeDISC

BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[TorchBench] Performance Signal Detected

zzpmiracle opened this issue · comments

TorchBench CI has detected a performance signal.

Affected Tests:

  • eval-cuda-fp32:
    • hf_Bert[dynamo-blade (latency)] 7.727 -> 6.695, +13.3558%
    • hf_Bert[dynamo-disc (latency)] 8.056 -> 7.003, +13.071%
  • eval-cuda-fp16:
    • hf_Bert[dynamo-blade (latency)] 4.466 -> 3.275, +26.6682%
    • hf_Bert[dynamo-disc (latency)] 4.482 -> 3.253, +27.4208%

detail data can be seen in oss://bladedisc-ci/TorchBench/gpu/tiny/20230528-18
created by TorchBench CI automatically