WARNING: Use at your own risk. This suite will run a number of benchmarks on your computer and could potentially damge it, especially if you're overclocked. Read what this does carefully and run the tests you mean to run.
Python Based Benchmarking Suite
This is a benchmarking suite to automate running various benchmarks on your machine using their CLI interfaces including the following features:
- Run benchmarking multiple times and compute average + standard deviation
- Wait a certain amount of time between benchmarks
- Discard initial runs to cache data
- Wait for CPU temperature/load to drop below a threshold before running (TODO)
- Store output into csv for future reference
- Extract OS, CPU, GPU, driver versions and other system data on each run
Note: This repo does not contain any of the benchmarks inherently as I do not have permission to share them. Please see the Install instructions below for how to set up the benchmarks
Note: Currently only supports Windows-based CPU benchmarks
Note: I have only tested this on my personal computers, if bugs are found please report them!
CPU Benchmarks
Implemented CPU Benchmarks
Benchmark | Description | Official CLI Documentation | Unofficial CLI Documentation | Notes |
---|---|---|---|---|
Cinebench R11.5 | Link | |||
Cinebench R15 | Link | |||
Cinebench R15 Extreme | Link | |||
Cinebench R20 | Link | |||
Cinebench R23 | Link | Link | ||
Pi Fast | Not really CLI, loads file | |||
y-cruncher | Download zip and open "Command Lines.txt" | |||
Blender | Link | |||
7 Zip | Link | |||
GPUPI 3.3.3 | Link | |||
GPUPI 3.2 | Link | |||
CPU-Z | Download zip and open "cpuz_readme.txt" |
Unsupported CPU Benchmarks
Benchmark | Reason for Lack of Support | CLI Documentation |
---|---|---|
HWBot x265 | No CLI Interface | |
HWBOT Prime | No CLI Interface | |
Super Pi | No CLI Interface | |
Corona 1.3 | No CLI Interface (Anandtech has a special version with CLI) | |
XTU | Not supported on AMD CPUs | |
Geekbench 3 | Requires Pro License for CLI | Link |
Geekbench 4 | Requires Pro License for CLI | Link |
Geekbench 5 | Requires Pro License for CLI | Link |
SPEC 2006 | Requires Pro License for CLI | Link |
SPEC CPU 2017 | Requires Pro License for CLI | Link |
PCMark2002 | Requires Pro License for CLI | |
PCMark04 | Requires Pro License for CLI | |
PCMark05 | Requires Pro License for CLI | |
PCMark Vantage | Requires Pro License for CLI | Link |
PCMark 7 | Requires Pro License for CLI | Link |
PCMark 8 | Requires Pro License for CLI | Link |
PCMark 10 | Requires Pro License for CLI | Link |
PCMark2002 | Requires Pro License for CLI | |
3DMark99 | Requires Pro License for CLI | |
3DMark2000 | Requires Pro License for CLI | |
3DMark2001 | Requires Pro License for CLI | |
3DMark03 | Requires Pro License for CLI | |
3DMark05 | Requires Pro License for CLI | |
3DMark06 | Requires Pro License for CLI | |
3DMark Vantage | Requires Pro License for CLI | Link |
3DMark 11 | Requires Pro License for CLI | Link |
3DMark | Requires Pro License for CLI | Link |
VRMark | Requires Pro License for CLI | Link |
Potential CPU Benchmarks
Benchmark | Official CLI Documentation | Unofficial CLI Documentation | Notes |
---|---|---|---|
pyprime 1.x | |||
pyprime 2.x | |||
AI-benchmark | |||
wPrime | |||
Realbench | |||
Sisoft Sandra Crytp | |||
Dolphin | |||
Handbrake | |||
Cygwin GCC 9.3.0 Compile with MT | |||
Chromium Compile with MSVC, Clang, Ninja | |||
Prime95 | |||
Adobe After Effects 2020 Puget Systesms | |||
Matlab R2020 Built-In Bnechmark | |||
Microsfot Excel Large Number Crunching Test | |||
Adobe Acrobat PDF Export PDF to PNG Images | |||
Adobe Photoshop Puget Systems Benchmark | |||
Adobe Premiere Warp Stabilizer | |||
DaVinci Resolve STudio Puget Systems Benchmark | |||
Adobe Premiere Puget Systems Export Test | |||
Adobe Premiere 4K 2 Pass H.264 Export | |||
Office | |||
Agisoft Photoscan 1.3: 2D to 3D Conversion | |||
Application Loading Time: GIMP 2.10.18 from a fresh install | |||
Compile Testing (WIP) | |||
Science | |||
3D Particle Movement v2.1 (Non-AVX + AVX2/AVX512) | |||
NAMD 2.13: Nanoscale Molecular Dynamics on ApoA1 protein | |||
Simulation | |||
Digicortex 1.35: Brain stimulation simulation | |||
Dwarf Fortress 0.44.12: Fantasy world creation and time passage | |||
Rendering | |||
Crysis CPU-Only: Can it run Crysis? What, on just the CPU at 1080p? Sure | |||
POV-Ray 3.7.1: Another Ray Tracing Test | |||
V-Ray: Another popular renderer | |||
Encoding | |||
AES Encoding: Instruction accelerated encoding | |||
WinRAR 5.90: Popular compression tool | |||
Legacy | |||
3DPM v1: Naïve version of 3DPM v2.1 with no acceleration | |||
X264 HD3.0: Vintage transcoding benchmark | |||
Web | |||
Kraken 1.1: Depreciated web test with no successor | |||
Octane 2.0: More comprehensive test (but also deprecated with no successor) | |||
Speedometer 2: List-based web-test with different frameworks | |||
Synthetic | |||
AIDA Memory Bandwidth | |||
Linux OpenSSL Speed (rsa2048 sign/verify, sha256, md5) | |||
LinX 0.9.5 LINPACK (where appropriate) |
GPU Benchmarks
Implemented GPU Benchmarks
Benchmark | Official CLI Documentation | Unofficial CLI Documentation | Notes |
---|---|---|---|
Cinebench R11.5 | Link | ||
Cinebench R15 | Link | ||
Cinebench R15 Extreme | Link |
Potential GPU Benchmarks
Benchmark | Official CLI Documentation | Unofficial CLI Documentation | Notes |
---|---|---|---|
GPUPI 3.3.3 | Link | ||
GPUPI 3.2 | Link | ||
Blender | Link | ||
Unigine Benchmarks | |||
Many game benchmarks |
Install Instructions
- Create an Anaconda 3.8 python environment
- See environment.yml for full list of packages
- Need to add in about anaconda, benchmark setup, etc...
How to Run
- Run main.py
- Add other details
Parameters
TBD