Automatic Benchmarking with JUBE

Benchmarking an HPC application usually involves numerous tasks, involving several runs of different parametrisations. Configuring, compiling, and running a benchmark on several platforms with the accompanied tasks of result verification and analysis needs a lot of administrative work and produces a lot of data. This process can be very error prone. The lecture provides an overview about the lightweight tool JUBE, which allows to structure the benchmark workflow, parametrise different parts of the application, submit jobs to an HPC system and finally analyse the various results. The environment allows users to create a documented, reproducible benchmarking setup, which can either be used within testing or scaling scenarios but also for production runs