Ordinal-Based Metric Learning for Learning Using Privileged Information

Abstract — Learning Using privileged Information (LUPI), originally proposed in [1], is an advanced learning paradigm that aims to improve the supervised learning in the presence of additional (privileged) information, available during training, but not in the test phase. We present a novel metric learn-ing methodology that is specially designed for incorporating privileged information in ordinal classification tasks, where there is a natural order on the set of classes. This is done by changing the global metric in the input space, based on distance relations revealed by the privileged information. The proposed model is formulated in the context of ordinal prototype based classification with metric adaptation. Unlike the existing nominal version of LUPI in prototype models [8], [9], in ordinal classifications the proposed LUPI model takes explicitly into account the class order information during the input space metric learning. Experiments demonstrate that incorporating privileged information via the proposed ordinal-based metric learning can improve the ordinal classification performance. I