Noname manuscript No. (will be inserted by the editor) Evaluation Measures for Hierarchical Classification: a Unified View and Novel Approaches

Abstract Hierarchical classification addresses the problem of classifying items into a hierarchy of classes. An important issue in hierarchical classification is the evaluation of different classification algorithms, an issue which is com-plicated by the hierarchical relations among the classes. Several evaluation measures have been proposed for hierarchical classification using the hierar-chy in different ways without however providing a unified view of the problem. This paper studies the problem of evaluation in hierarchical classification by analysing and abstracting the key components of the existing performance measures. It also proposes two alternative generic views of hierarchical eval-uation and introduces two corresponding novel measures. The proposed mea-sures, along with the state-of-the-art ones, are empirically tested on three large datasets from the domain of text classification. The empirical results illustrat