Abstract—Supercomputer I/O loads are often dominated by writes. HPC (High Performance Computing) file systems are designed to absorb these bursty outputs at high bandwidth through massive parallelism. However, the delivered write band-width often falls well below the peak. This paper characterizes the data absorption behavior of a center-wide shared Lustre parallel file system on the Jaguar supercomputer. We use a statistical methodology to address the challenges of accurately measuring a shared machine under production load and to obtain the distribution of bandwidth across samples of compute nodes, storage targets, and time intervals. We observe and quantify limitations from competing traffic, contention on storage servers and I/O routers...
Parallel input/output in high performance computing is a field of increasing importance. In particul...
Estimating I/O time of applications is critical for computing sys-tem research and developments, suc...
Beside the computational scalability of an HPC application, its I/O behaviour can significantly infl...
Parallel scientific applications require high-performance I/O support from underlying file systems. ...
Parallel scientific applications require high-performance I/O support from underlying file systems. ...
I/O performance is a critical aspect of data-intensive scientific computing. We seek to advance the ...
One of the major tasks of a supercomputer center is managing the massive amount of data generated by...
Phenomenal improvements in the computational performance of multiprocessors have not been matched by...
Input/Output (I/O) operations can represent a significant proportion of the run-time of parallel sci...
High-performance parallel file systems are needed to satisfy tremendous I/O requirements of parallel...
With the exponential growth of high-fidelity sensor and simulated data, the scientific community is ...
Input/Output (I/O) operations can represent a significant proportion of the run-time of parallel sci...
Solving the bottleneck of I/O is key in the move towards exascale computing. Research communities mu...
Rapid increases in the computational speeds of multiprocessors have not been matched by correspondin...
Scientific computing workloads at HPC facilities have been shifting from traditional numerical simul...
Parallel input/output in high performance computing is a field of increasing importance. In particul...
Estimating I/O time of applications is critical for computing sys-tem research and developments, suc...
Beside the computational scalability of an HPC application, its I/O behaviour can significantly infl...
Parallel scientific applications require high-performance I/O support from underlying file systems. ...
Parallel scientific applications require high-performance I/O support from underlying file systems. ...
I/O performance is a critical aspect of data-intensive scientific computing. We seek to advance the ...
One of the major tasks of a supercomputer center is managing the massive amount of data generated by...
Phenomenal improvements in the computational performance of multiprocessors have not been matched by...
Input/Output (I/O) operations can represent a significant proportion of the run-time of parallel sci...
High-performance parallel file systems are needed to satisfy tremendous I/O requirements of parallel...
With the exponential growth of high-fidelity sensor and simulated data, the scientific community is ...
Input/Output (I/O) operations can represent a significant proportion of the run-time of parallel sci...
Solving the bottleneck of I/O is key in the move towards exascale computing. Research communities mu...
Rapid increases in the computational speeds of multiprocessors have not been matched by correspondin...
Scientific computing workloads at HPC facilities have been shifting from traditional numerical simul...
Parallel input/output in high performance computing is a field of increasing importance. In particul...
Estimating I/O time of applications is critical for computing sys-tem research and developments, suc...
Beside the computational scalability of an HPC application, its I/O behaviour can significantly infl...