D6.3.2: Final benchmark suite

This deliverable D6.3.2 takes its predecessor D6.3.1 as the starting point for the definition of the final PRACE Application Benchmark Suite (PABS). This report describes the process from initial to final benchmark suite in detail. Scalability input has been received from task 5.4, which is responsible for the assessment of the PRACE prototypes, using the PRACE benchmark suite. Ease of use of the final benchmark suite in future situations is assured by the integration of the final benchmark suite into a framework, including testing procedures. The final PABS is part of D6.3.2, including its integration in the benchmark framework. Accompanying the process to the final benchmark suite, other software aspects are relevant as well. These include synthetic benchmarking and performance analysis tools, which are both important when the procurement of Tier-0 systems is prepared. D6.3.2, again with D6.3.1 as a starting point, describes the required contents of a synthetic benchmark, which is able to assess key hardware and system software aspects of Tier-0 systems; the actual assessment of the PRACE prototype systems is done in WP5. With respect to performance analysis tools, combinations of PRACE prototypes and performance analysis tools are tested and reported upon. The PABS has been prepared in such a way that it offers optimal flexibility. This includes the possibility to use a subset of the PABS for procurement of specific Tier-0 architectures, and also the possibility to adapt the contents of the subset towards the specific wishes of the installing Tier-0 Principal Partner. Industrial and pan-European coverage of the applications in the PABS is another aspect which has been included, especially when proceeding from the initial PABS to the final PABS. Yet another aspect is how to weight the various applications in the benchmark subset, together with the synthetic benchmark results and possibly less technical aspects. It should be clear that the PABS is instrumental in the selection process of Tier-0 systems, but has to be accompanied by other requirements. This document includes the results of efforts carried out during the Extension Phase in the first half of 2010