Automated MPI Correctness Checking What if there was a magic option?

Abstract. Writing correct and portable MPI programs is hard. Out of bound parameters, inconsistent use of data types and many other complex violations of using MPI correctly can now automatically be detected at runtime. While interactive debuggers have been extended to handle the concurrent processes of MPI applications, still there are numerous bugs which are hard (because it would require a prohibitive amount of manual work) or even impossible (because it requires more control over the program execution than available via a debugger) to find with just a debugger. This paper presents the new MPI correctness checking feature of Intel r ○ Trace Analyzer and Collector, which solves this problem. We describe its design, implementation and performance. As a use case an analysis of the HPCC benchmark is presented which actually contains some violations of the MPI standard in the 1.0.0 release