A Precision-Recall Criterion Based Consensus Model For Fusing Multiple Segmentations

This paper presents a general framework for seamlessly combining multiple low cost and inaccurate estimated segmentation maps (with an arbitrary number of regions) of the same scene to achieve a final improved segmentation. The proposed fusion model is derived from the well-known precision-recall criterion, specially dedicated to the specific clustering prob-lem of any spatially indexed data and which is also efficient and widely used in the vision community for evaluating both a region-based segmentation and the quality of contours pro-duced by this segmentation map compared to one or multiple ground-truth segmentations of the same image. The proposed combination framework is here specifically designed to be robust with respect to outlier segmentations (that appear to be inconsistent with the remain-der of the segmentation ensemble) and includes an explicit internal regularization factor reflecting the inherent ill-posed nature of the segmentation problem. We propose also a hierarchical and efficient way to optimize the consensus energy function related to this fu-sion model that exploits a simple and deterministic iterative relaxation strategy combining the different segments or individual regions belonging to the segmentation ensemble in the final solution. The experimental results on the Berkeley database with manual ground truth segmentations show the effectiveness of our combination model. Index Terms: cluster ensemble algorithm, combination of multiple segmentations, F-measure, precision-recall, segmentation ensemble