Hands-on Practical Hybrid Parallel Application Performance Engineering

This tutorial presents state-of-the-art performance tools for leading-edge HPC systems founded on the community-developed Score-P instrumentation and measurement infrastructure, demonstrating how they can be used for performance engineering of effective scientific applications based on standard MPI, OpenMP, hybrid combination of both, and increasingly common usage of accelerators. Parallel performance tools from VI-HPS.org are introduced and featured in hands-on exercises with Score-P, Scalasca, Vampir and TAU. We present the complete workflow of performance engineering, including instrumentation, measurement (profiling and tracing, timing and PAPI hardware counters), data storage, analysis, tuning and visualization. Emphasis is placed on how tools are used together for identifying performance problems and investigating optimization alternatives. Using an AWS instance of E4S with all of the necessary tools, participants will conduct exercises with support for a remote desktop session for GUI tools. This will help to prepare participants to locate and diagnose performance bottlenecks in their own parallel programs