Reducing the overhead of an MPI application-level migration approach

Cores González, Iván
Rodríguez, Mónica
González, Patricia
Martín, María J.

Open PDF

Open link

Publication date

January 2016

DOI

10.1016/j.parco.2016.01.012.

Publisher

Elsevier BV

ISSN

0167-8191

Journal

Parallel Computing

Abstract

[Abstract] Process migration provides many benefits for parallel environments including dynamic load balance, data access locality, or fault tolerance. This work proposes a solution that reduces the memory and I/O overhead in an application-level checkpoint-based migration approach. The proposal splits the checkpoint files in order to overlap the writing of the state in the terminating processes with the read and restarting operation in the newly spawned processes. It has been tested using the MPI NAS Parallel Benchmarks, showing encouraging results, both in terms of memory consumption and I/O migration times.Ministerio de Economía y Competitividad; TIN2013-42148-PGalicia. Consellería de Cultura, Educación e Ordenación Universitaria; GRC201...