Combined key-frame extraction and object-based video segmentation

In this paper, we propose a coherent framework for joint key-frame extraction and object-based video segmentation. Conventional key-frame extraction and object segmentation are usually implemented independently and separately due to the fact that they are on different semantic levels. This ig-nores the inherent relationship between key-frames and ob-jects. The proposed method extracts a small number of key-frames within a shot so that the divergence between video objects in a feature space can be maximized, supporting ro-bust and efcient object segmentation. This method can uti-lize advantages of both temporal and object-based video segmentations, and be helpful to build a unied framework for content-based analysis and structured video represen-tation. Theoretical analysis and simulation results on both synthetic and real video sequences manifest the efciency and robustness of the proposed method. 1