Computational scientific research is evolving rapidly with faster data acquisition rates, larger datasets, and increasingly complex processing workflows. Automating these interconnected research processes is critical to fully utilize the power of supercomputing and leading-edge data storage and technologies to drive breakthrough science discoveries.
The Nexus effort at DOE’s Argonne National Laboratory enables large-scale science by integrating experimental and computational user facilities in a seamless research infrastructure. For over a decade Argonne researchers have been developing tools and methods to blend its world-class computing resources with data-intensive experiments.
This repository contains examples and tools for Integrated Research Infrastructure (IRI) workflows deployed on ALCF machines. Many of the tools described here utilize Globus Flows and Globus Data Transfers. These tools have been successfully used to deploy workflows for experiments at the Advanced Photon Light Source and General Atomics’ DIII-D. ALCF also supports other tools in the regime of remote workflows (e.g. Balsam). Any questions can be directed to the issues on this repository or support@alcf.anl.gov.