Comprehensive Workload Analysis and Modeling of a Petascale Supercomputer

Abstract. The performance of supercomputer schedulers is greatly af-fected by the characteristics of the workload it serves. A good under-standing of workload characteristics is always important to develop and evaluate different scheduling strategies for an HPC system. In this pa-per, we present a comprehensive analysis of the workload characteristics of Kraken, the world’s fastest academic supercomputer and 11th on the latest Top500 list, with 112,896 compute cores and peak performance of 1.17 petaflops. In this study, we use twelve-month workload traces gath-ered on the system, which include around 700 thousand jobs submitted by more than one thousand users from 25 research areas. We investi-gate three categories of the workload characteristics: 1) general charac-teristics, including distribution of jobs over research fields and different queues, distribution of job size for an individual user, job cancellation rate, job termination rate, and walltime request accuracy; 2) tempo-ral characteristics, including monthly machine utilization, job temporal distributions for different time periods, job inter-arrival time between temporally adjacent jobs and jobs submitted by the same user; 3) exe-cution characteristics, including distributions of each job attribute, such as job queuing time, job actual runtime, job size, and memory usage, and the correlations between these job attributes. This work provides a realistic basis for scheduler design and comparison by studying the supercomputer’s workload with new approaches such as using Gaussian mixture model, and new viewpoints such as from the perspective of user community. To the best of our knowledge, it’s the first research to sys-tematically investigate the workload characteristics of a petascale super-computer that is dedicated to open scientific research