An approach to locality-conscious load balancing and transparent memory hierarchy management with a global-address-space parallel programming model

The development of efficient parallel out-of-core appli-cations is often tedious, because of the need to explicitly manage the movement of data between files and data struc-tures of the parallel program. Several large-scale applica-tions require multiple passes of processing over data too large to fit in memory, where significant concurrency exists within each pass. This paper describes a global-address-space framework for the convenient specification and effi-cient execution of parallel out-of-core applications operat-ing on block-sparse data. The programming model provides a global view of block-sparse matrices and a mechanism for the expression of parallel tasks that operate on block-sparse data. The tasks are automatically partitioned into phases that operate on memory-resident data, and mapped onto processors to optimize load balance and data local-ity. Experimental results are presented that demonstrate the utility of the approach.