alibaba / BladeDISC

BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[TorchBench] Performance Signal Detected

zzpmiracle opened this issue · comments

TorchBench CI has detected a performance signal.

Affected Tests:

  • eval-cuda-fp32:
    • hf_Bert[dynamo-blade (latency)] 7.727 -> 6.483, +16.0994%
    • hf_Bert[dynamo-disc (latency)] 8.056 -> 6.965, +13.5427%
  • eval-cuda-fp16:
    • hf_Bert[dynamo-blade (latency)] 4.466 -> 3.257, +27.0712%
    • hf_Bert[dynamo-disc (latency)] 4.482 -> 3.305, +26.2606%

detail data can be seen in oss://bladedisc-ci/TorchBench/gpu/tiny/20230521-07
created by TorchBench CI automatically