Compiler and Runtime Support for Outof-Core HPF Programs

This paper describes the design of a compiler which can translate ont-of-core programs written in a data parallel lan-guage like HPF. Such a compiler is required for compiIing large scale scientific applications, such as the Grand Chal-ienge applications, which deal with enormous quantities of data. We propose a framework by which a compiler together with appropriate runtime support can translate an out-of-core HPF program to a message passing node program with explicit parallel 1/0. We describe the basic model of the compiler and the various transformations made by the com-piler. We also discuss the runtime routines used by the com-rriler for I/0 and communication. In order to minimize I/0. ~he runtirne support system can reuse data already fetched into memory. The working of the compiler is illustrated us-ing two out-of-core applications, namely a Laplace equation solver and LU Decomposition, together with performance results on the Intel Touchstone Delta.