microsoft / superbenchmark

A validation and profiling tool for AI infrastructure

https://aka.ms/superbench

Repository from Github https://github.commicrosoft/superbenchmark

microsoft/superbenchmark Issues

[Suggestion] Rely on tar.gz package instead of git branch/tag
Closed 3 months ago1
[Feature Request] Support setuptools > v65.7.0
Updated 3 months ago
What is the proper way to write a rule.yaml for result summary?
Closed 4 months ago1
V0.11.0 Release Plan
Closed 5 months ago
[Doc improvement]: metric names are not identical in user-tutorial
Closed 6 months ago
[Suggestion] Separate benchmark keys for nccl without sharp and nccl with sharp
Updated 7 months ago
Data Diagnosis command is not idempotent when diagnosis rule file uses failure_check function
Closed 7 months ago6
Add gemm-flops support of Ada Lovelace (L4, L40, L40s), compute capability: 8.9
Closed 7 months ago1
where can I get benchmark parameters definition？
Closed 7 months ago1
Unbale to run on Nvidia A100
Closed 8 months ago1
V0.10.0 Test Plan
Closed a year ago
V0.10.0 Release Plan
Closed a year ago
[Enhancement] - Add HPL random generator to gemm-flops with ROCm
Closed a year ago
Urgent: while executing the superbench, it's failing (UBUNTU)
Closed a year ago2
Not able to test IB-TRAFFIC for NDR(H-100) Cluster
Closed a year ago3
A question about Hived
Closed a year ago5
default gpu_burn test fails with cp error
Closed a year ago2
V0.9.0 Test Plan
Closed 2 years ago
V0.9.0 Release Plan
Closed 2 years ago
Error: parsing sudo passwords containing special symbols
Closed 2 years ago1
pytorch cannot find libopen-orted-mpir.so
Closed 2 years ago2
sb deploy fails due to permission issue,
Closed 2 years ago10
out-of-date reference link
Closed 2 years ago1
Superbench result contains null characters.
Closed 2 years ago1
[Bug] ansible_runner updated to 2.3.2 last week, superbench fails with python 3.6
Closed 2 years ago3
why is it probing for nviida when running on MI?
Closed 2 years ago7
cublaslt_gemm fp8 does not work with RTX 40
Closed 2 years ago4
Some test does not support CS 8.9(RTX 4080/4090)
Closed 2 years ago2
superbench failed at default most typical run config
Closed 2 years ago8
Run benchmark failed (superbenchmark-0.8.0)
Closed 2 years ago2
V0.8.0 Test Plan
Closed 2 years ago
V0.8.0 Release Plan
Closed 2 years ago
Found no NVIDIA driver on your system.
Closed 2 years ago5
cublaslt_gemm microbenchmark fails with running with large matrix sizes.
Closed 2 years ago5
V0.7.0 Test Plan
Closed 2 years ago
Executor/Run benchmark failed messages while running bert-large model with superbench
Closed 2 years ago2
Executor/Run benchmark failed messages while running vgg models with superbench
Closed 2 years ago1
V0.7.0 Release Plan
Closed 2 years ago
/sys/fs/cgroup/cpuacct/cpuacct missing causing superbench failures
Closed 2 years ago1
Run failed (Failed to get information on remote file)
Closed 2 years ago3
why '/dev/nvidia-uvm' is a required file check for nvidia GPU?
Closed 2 years ago2
'sb deploy' is expected to exit with non-zero when failed
Closed 2 years ago
sb should return non-zero exit code when executor.py failed
Closed 2 years ago1
Passing multiple test configurations to cublas microbenchmark
Closed 2 years ago2
ib validation benchmark should support mixed IB device naming schema
Closed 3 years ago1
V0.6.0 Test Plan
Closed 3 years ago
superbench logging: 'color' output should be optional
Closed 3 years ago4
superbench mpi job should use the proper Ethernet interface
Closed 3 years ago2
'sb result diagnosis' should exit with valid error code when input data format has error
Closed 3 years ago1
docker image /root/hostfile cannot be updated with redeploy
Closed 3 years ago2