A Comparison of Distributed Data Parallel Multimedia Computing over Conventional and Optical Wide-Area Networks∗

The research area of Multimedia Content Analysis (MMCA) considers all aspects of the automated extraction of knowledge from multimedia data streams and archives. As individual compute clusters can not satisfy the increas-ing computational demands of emerging MMCA problems, distributed supercomputing on collections of compute clus-ters is rapidly becoming indispensable. A well-known man-ner of obtaining speedups in MMCA is to apply data par-allel approaches, in which commonly used data structures (e.g. video frames) are being scattered among the avail-able compute nodes. Such approaches work well for in-dividual compute clusters, but- due to the inherently large wide-area communication overheads- these are generally not applied in distributed cluster systems. Given the in-creasing availability of low-latency, high-bandwidth optical wide-area networks, however, wide-area data parallel exe-cution may now become a feasible acceleration approach. This paper discusses the wide-area data parallel execution of a realistic MMCA problem. It presents experimental re-sults obtained on real distributed systems, and provides a feasibility analysis of the applied parallelization approach.