Run--Time Methods for Parallelizing Partially Parallel Loops

In this paper we give a new run--time technique for finding an optimal parallel execution schedule for a partially parallel loop, i.e., a loop whose parallelization requires synchronization to ensure that the iterations are executed in the correct order. Given the original loop, the compiler generates inspector code that performs run--time preprocessing of the loop's access pattern, and scheduler code that schedules (and executes) the loop iterations. The inspector is fully parallel, uses no synchronization, and can be applied to any loop. In addition, it can implement at run--time the two most effective transformations for increasing the amount of parallelism in a loop: array privatization and reduction parallelization (element--wise). We also describe a new scheme for constructing an optimal parallel execution schedule for the iterations of the loop. 1 Introduction To achieve a high level of performance for a particular program on today's supercomputers, software developers are oft..