Answers are grounded in this paper and cite their sources.
High-performance computing (HPC) storage and I/O software stacks have been challenging to configure due to multiple software layers, interdependencies among those layers, and the number of parameters to tune within each layer. The storage stack has become increasingly complex with the ever-growing sets of new software and hardware. In addition, there is a shift in HPC applications from modeling and simulations (mod-sim) to AI training and inference. While several efforts focused on tuning I/O parameters of write-heavy simulation workloads, configuring I/O for random and read-heavy AI applications has still been in progress. Although the HPC storage stack could be reconfigured to meet these diverse write and read requirements, finding optimal I/O configurations for even a single application is a challenging task. This survey proposes a taxonomy of HPC storage and I/O system configurations and reconfigurability for bringing a consensus to the I/O parameters that are tunable by clients (i.e., users and applications). In this paper, we survey I/O tuning and optimization, harnessing the HPC I/O system configuration knowledge from the past decade. This paper can serve as a primary source of information for HPC I/O researchers and developers to design and optimize novel tuning strategies that improve storage and I/O system reconfigurability and performance.
No takes yet. Share an insight, caveat, or question.
Salimiparsa et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: