Modeling the Impact of System-Level Parameters on I/O Performance of HPC Applications

Modern High Performance Computing (HPC) workloads prioritize data, challenging storage systems to meet rising I/O demands. The network's role in inter-node communication and data transfer significantly impacts overall application performance. Our study systematically examines bandwidth and latency variations in CephFS due to diverse I/O patterns. We formalize latency, bandwidth, I/O size, and block-to-file size ratio relationships and train a model for predicting bandwidth and estimating latency in similar I/O workloads, offering valuable insights into optimizing HPC storage.