Static task scheduling and grain packing in parallel processing systems

Graduation date: 1988We extend previous results for optimally scheduling\ud concurrent program modules, called tasks, on a fixed, finite number\ud of parallel processors in two fundamental ways: (1) we introduce a\ud new heuristic which considers the time delay imposed by message\ud transmission among concurrently running tasks; and (2) we\ud introduce a second heuristic which maximizes program execution\ud speed by duplicating tasks. Simulation results are given which\ud suggest an order of magnitude improvement in program execution\ud speed over previous scheduling heuristics. The first solution, called\ud ISH, (insertion scheduling heuristic) provides only a small\ud improvement over current solutions but has a smaller time\ud complexity than DSH, 0(N²). DSH (duplication scheduling heuristic),\ud is an 0(N⁴) heuristic that (1) gives up to an order of magnitude\ud improvement in performance, (2) solves the max-min problem of\ud parallel processor scheduling by duplicating selected scheduled\ud tasks on some PEs, and (3) gives monotonically growing\ud improvements as the number of PEs is increased. The max-min\ud problem is caused by the trade-off between maximum parallelism versus minimum communication delay.\ud The DSH is also applied in "Grain Packing", which is a new way\ud to define the grain size for a user program on a specific parallel\ud processing system. Instead of defining the grain size before\ud scheduling, grain packing uses the fine grain scheduling to construct\ud larger grains. In this way all available parallelism is considered as\ud well as the communication delay