Enhancing Performance Portability of MPI Applications Through Annotation-Based Transformations

optimization, Abstract—MPI is the de facto standard for portable parallel programming on high-end systems. However, while the MPI standard provides functional porta-bility, it does not provide sufficient performance portability across platforms. We present a framework that enables users to provide hints about communication patterns used within MPI applications. These annotations are then used by an automated program transformation system to leverage different MPI operations that better match each system’s capabilities. Our framework currently supports three au-tomated transformations: coalescing of operations in MPI one-sided communications; transformation of blocking com-munications to nonblocking, which enables communication-computation overlap; and selection of the appropriate com-munication operators based on the cache-coherence support of the underlying platform. We use our annotation-based approach to optimize several benchmark kernels, and we demonstrate that the framework is effective at automatically improving performance portability for MPI applications. Keywords-high performance computing, parallel program-ming, automatic programming I