M.: MPIBlib: Benchmarking MPI Communications for Parallel Computing on Homogeneous and Heterogeneous Clusters

Abstract. In this paper, we analyze existing MPI benchmarking suites, focusing on two restrictions that prevent them from a wider use in appli-cations and programming systems. The first is a single method of mea-surement of the execution time of MPI communications implemented by each of the suites. The second one is the design of the suites in the form of a standalone executable program that cannot be easily integrated into applications or programming systems. We present a more flexible bench-marking package, MPIBlib, that provides multiple methods of measure-ment, both operation-independent and operation-specific. This package can be used not only for benchmarking but also as a library in applica-tions and programming systems for communication performance model-ing and optimization of MPI operations