The Effect of Communication Time Delays in Parallel Computations

Parallel computer architectures utilize a set of computational elements (CE) to achieve performance that is not attainable on a single processor, or CE, computer. A common architecture is the cluster of otherwise independent computers communicating through a shared network. To make use of parallel computing resources, problems must be broken down into smaller units that can be solved individually by each CE while exchanging information with CEs solving other problems.ANNUAL ALLERTON CONFERENCE ON COMMUNICATION CONTROL AND COMPUTIN