Language and Compiler Support for Hybrid-Parallel Programming on SMP Clusters

Abstract. In this paper we present HPF extensions for clusters of SMPs and their implementation within the VFC compiler. The main goal of these extensions is to optimize HPF for clusters of SMPs by enhanc-ing the functionality of the mapping mechanisms and by providing the user with high-level means for controlling key aspects of distributed-memory and shared-memory parallelization. Based on the proposed lan-guage extensions, the VFC compiler adopts a hybrid parallelization strat-egy which closely reflects the hierarchical structure of SMP clusters by exploiting shared-memory parallelism based on OpenMP within nodes and distributed-memory parallelism utilizing MPI across nodes. We de-scribe the language extensions, outline the hybrid parallelization strategy of VFC and present experimental results which show the effectiveness of these techniques