A Statistical Analysis of Performance in the 2021 CEC-GECCO-PESGM Competition on Evolutionary Computation in the Energy Domain

Evolutionary algorithms (EAs) have emerged as an efficient alternative to deal with real-world applications with high complexity. However, due to the stochastic nature of the results obtained using EAs, the design of benchmarks and competitions where such approaches can be evaluated and compared is attracting attention in the field. In the energy domain, the “2021 CEC-GECCO-PESGM Competition on Evolutionary Computation in the Energy Domain: Smart Grid Applications” provides a platform to test and compare new EAs to solve complex problems in the field. However, the metric used to rank the algorithms is based solely on the mean fitness value (related to the objective function value only), which does not give statistical significance to the performance of the algorithms. Thus, this paper presents a statistical analysis using the Wilcoxon pair-wise comparison to study the performance of algorithms with statistical grounds. Results suggest that, for track 1 of the competition, only the winner approach (first place) is significantly different and superior to the other algorithms; in contrast, the second place is already statistically comparable to some other contestants. For track 2, all the winner approaches (first, second, and third) are statistically different from each other and the rest of the contestants. This type of analysis is important to have a deeper understanding of the stochastic performance of algorithmsThis research has received funding from FEDER funds through the Operational Programme for Competitiveness and Internationalization (COMPETE 2020), under Project POCI01-0145-FEDER-028983; by National Funds through the FCT Portuguese Foundation for Science and Technology, under Projects PTDC/EEI-EEE/28983/2017(CENERGETIC),CEECIND/02814/2017, and UIDB/000760/2020