Program Transformation and Runtime Support for Threaded MPI Execution on Shared Memory Machines

MPI-based explicitly parallel programs have been widely used for developing highperformance applications on various platforms. However because of the restriction in the MPI computation model, conventional implementations on shared memory machines map each MPI node to an OS process, which can suffer serious performance degradation in the presence of multiprogramming when the space/time sharing policy is employed. This paper studies compile/run-time techniques for enhancing performance portability of MPI code running on multiprogrammed shared memory machines. The proposed techniques allow a large class of MPI C programs to be executed efficiently and safely using threads. The compile-time transformation adopts thread-specific data structures to eliminate the use of global and static variables in C code. The run-time support includes a provably-correct efficient communication protocol using lock-free data structures and taking advantages of address space sharing among threads. The experim..