alibaba / BladeDISC

BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[TorchBench] Performance Signal Detected

zzpmiracle opened this issue · comments

TorchBench CI has detected a performance signal.

Affected Tests:

  • eval-cuda-fp32:
    • hf_Bert[dynamo-blade (latency)] 7.727 -> 6.486, +16.0606%
    • hf_Bert[dynamo-disc (latency)] 8.056 -> 6.871, +14.7095%
  • eval-cuda-fp16:
    • hf_Bert[dynamo-blade (latency)] 4.466 -> 3.217, +27.9669%
    • hf_Bert[dynamo-disc (latency)] 4.482 -> 3.243, +27.6439%

detail data can be seen in oss://bladedisc-ci/TorchBench/gpu/tiny/20230528-06
created by TorchBench CI automatically