DiskSpd

DiskSpd is a storage performance tool from the Windows, Windows Server and Cloud Server Infrastructure engineering teams at Microsoft. Please visit https://github.com/Microsoft/diskspd/wiki for updated documentation.

In addition to the tool itself, this repository hosts measurement frameworks which utilize DiskSpd. The initial example is VM Fleet, used for Windows Server Hyper-Converged environments with Storage Spaces Direct.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

Releases

The Releases page includes pre-compiled binaries (ZIP) and source code for the most current releases of the DiskSpd tool. The latest update to DiskSpd can always be downloaded from https://github.com/Microsoft/diskspd/releases/latest/download/DiskSpd.zip (aka https://aka.ms/getdiskspd).

What's New?

DISKSPD

DISKSPD 2.2 6/3/2024

NOTE: changes to the asynchronous IO loop will require rebaselining results with queue depths greater than 1. The new design drains the completion queue more aggressively, shrinking delays that impacted latency measurement especially on faster storage targeting higher queue depths. Latency measurement is improved at a very small cost to rates, as well as improving rates when latency measurement is not used (-D or -L) due to batch dequeue.

Smaller IO sizes will see the most change.

New: Socket, NUMA, Core and Power Efficiency Class (big/little cores) added to processor topology reporting (XML and text output)
- topology elements only displayed in text results when > 1 are present (e.g. multi-socket systems)
- CPU numbering remains group relative, as is the new Core numbering
- highest Power Efficiency Class is marked with a P suffix (this will usually be 1P v. 0)
- NOTE: efficiency classes can have major impact; work on heterogenous systems must be aware of core properties in combination with thread affinity rules (see -a and -n )
New: active power scheme reporting
New: base target offset switch now allows range specification: -Bbase[:length]; replaces -B and -f
post-run latency histogram processing now significantly faster
verbose output is more consistent; includes actual warmup, measured and cooldown intervals v. expected

Binary release supports down to Windows 8 and Windows Server 2012; now uses the Universal CRT.

DISKSPD 2.1 7/1/2021

New -g<n>i form allowing throughput limit specification in units of IOPS (per specified blocksize)
New -rs<pct> to specify mixed random/sequential operation (pct random); geometric distribution of run lengths
New -rd<distribution> to specify non-uniform IO distributions across target
- pct by target percentage
- abs by absolute offset
New -Rp<text|xml> to show specified parameter set in indicated profile output form; works with -X XML profiles and conventional command line
XML results/profiles are now indented for ease of review
Text result output updates
- now shows values in size units (K/M/G, and now TiB) to two decimals
- thread stride no longer shown unless specified
- -F/-O threadpool parameters shown
XML profiles can now be built more generically
- XML profiles can be stated in terms of templated target names (*1, *2), replaced in order from command line invocation
- the command line now allows options alongside -X: -v, -z, -R and -W/-d/-C along with template target specs

DISKSPD 2.0.21a 9/21/2018

Added support for memory mapped I/O:
- New -Sm option to enable memory mapped I/O
- New -N<vni> option to specify flush options for memory mapped I/O
Added support for providing Event Tracing for Windows (ETW) events
Included a Windows Performance Recorder (WPR) profile to enable ETW tracing
Added system information to the ResultParser output

DISKSPD 2.0.20a 2/28/2018

Changes that may require rebaselining of results:
- New random number generator that may show an observable decreased cost
- Switched to 512-byte aligned buffers with the -Z option to increase performance
New -O option for specifying the number of outstanding IO requests per thread
New -Zr option for per-IO randomization of write buffer content
XML: Adds a new <ThreadTarget> element to support target weighting schemes
Enhanced statistics captured from IOPS data
Added support for validating XML profiles using an in-built XSD
Added support for handling RAW volumes
Updated CPU statistics to work on > 64-core systems
Updated calculation and accuracy of CPU statistics
Re-enable support for ETW statistics

DISKSPD 2.0.18a 5/31/2016

update /? example to use -Sh v. deprecated -h
fix operation on volumes on GPT partitioned media (:)
fix IO priority hint to proper stack alignment (if not 8 byte, will fail)
use iB notation to clarify that text result output is in 2^n units (KiB/MiB/GiB)

DISKSPD 2.0.17a 5/01/2016

-S is expanded to control write-through independent of OS/software cache. Among other things, this allows buffered write-through to be specified (-Sbw).
XML: adds a new <WriteThrough> element to specify write-through
XML: <DisableAllCache> is no longer emitted (still parsed, though), in favor or <WriteThrough> and <DisableOSCache>
Text output: OS/software cache and write-through state are now documented separately (adjacent lines)
Latency histogram now reports to 9-nines (one part in one billion) in both text and XML output
Error message added for failure to open write-content source file (-Z<size>,<file>)

VM Fleet

VM Fleet is a performance characterization and analyst framework for exploring the storage capabilities of Windows Server Hyper-Converged environments with Storage Spaces Direct.

VM Fleet 2.1.0.0 4/3/2024

Support for Arc VM management (only applicable to clusters managed by Arc)
Set-FleetRunProfileScript - produce a free-run script based on one of the defined workload profiles
Watch-FleetCPU - new support for monitoring guest VCPU utilization (-Guest); can handle data outages
Fix: performance counter handling now manages intermittent data dropouts (per conventional relog.exe)
Fix: mid-run vm health check now handles the possibility of many vms taking longer than intended runtime to validate; early exit to avoid false failures
Fix: ignore reboot required indication from cache layer when changing cache behavior; avoid false failure

VM Fleet 2.0.2.2 12/1/2021

Fix cluster remoting issue during New-Fleet caused by 2.0.2.1 work
Use timestamped logging in New-Fleet, simplify and de-colorize default output

VM Fleet 2.0.2.1 11/9/2021

Fix cluster remoting issues in Move-Fleet and Get-FleetDataDiskEstimate
Fix timing issue with Start-FleetSweep; always start from fleet pause to avoid triggering free run
Use uniqueness to guarantee Start-FleetSweep runs profile in case of repeat

VM Fleet 2.0.2 11/2/2021

Windows Server 2019/RS5 host operation now confirmed & supported
Read cache warmup for HDD capacity systems should now be faster

Set-FleetPause will wait for VM responses before completion by default (see -Timeout)

Several minor fixes including:

Disable Windows Recovery Console in fleet VMs
Fix: Show-Fleet IOPS view now aggregates all VM disk devices
Fix: clean up leaked/conflicting data collectors and blg automatically

VM Fleet 2.0 9/22/2021

major release and rewrite as a first class Powershell module
original script-based VM Fleet remains available at Frameworks/VMFleet1.0
see the documentation in the Wiki

Source Code

The source code for DiskSpd is hosted on GitHub at:

https://github.com/Microsoft/diskspd

Any issues with DiskSpd can be reported using the following link:

https://github.com/Microsoft/diskspd/issues

microsoft / diskspd