Huihuo Zheng's repositories
dlio_ml_workloads
Reference workloads for DLIO Benchmark
MLPerf_training
Reference implementations of MLPerf™ training benchmarks
dlio_profiling
This repo demonstrate how to profile I/O for deep learning applications. This is based on VaniDL
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
dlio-profiler
A low-level profiler for capture I/O calls from deep learning applications.
dlio_benchmark
An I/O benchmark for deep Learning applications
E4S-Documenter
A tool to generate documentation for a project based on project metadata (README, Changelog, License, etc.) stored in a yaml file.
exahdf5_sdk
ExaHDF5 project build scripts
incubator-mxnet
Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
user-guides
ALCF Systems User Documentation