A dataset and evaluation methodology for visual saliency

Recently, visual saliency has drawn great research interest in the field of computer vision and multimedia. Various ap-proaches aiming at calculating visual saliency have been pro-posed. To evaluate these approaches, several datasets have been presented for visual saliency in images. However, there are few datasets to capture spatiotemporal visual saliency in video. Intuitively, visual saliency in video is strongly affected by temporal context and might vary significantly even in vi-sually similar frames. In this paper, we present an extensive dataset with 7.5-hour videos to capture spatiotemporal visual saliency. The salient regions in frames sequentially sampled from these videos are manually labeled by 23 subjects and then averaged to generate the ground-truth saliency maps. We also present three metrics to evaluate competing approaches. Several typical algorithms were evaluated on the dataset. The experimental results show that this dataset is very suitable for evaluating visual saliency. We also discover some interest-ing findings that would be addressed in future research. Cur-rently, the dataset is freely available online together with the source code for evaluation. Index Terms — Visual saliency, dataset, evaluation met-rics, saliency map, salient region