Rapid Cut Detection On Compressed Video

The temporal segmentation of a video sequence is one of the most important aspects for video processing, analysis, indexing, and retrieval. Most of existing techniques to address the problem of identifying the boundary between consecutive shots have focused on the uncompressed domain. However, decoding and analyzing of a video sequence are two extremely time-consuming tasks. Since video data are usually available in compressed form, it is desirable to directly process video material without decoding. In this paper, we present a novel approach for video cut detection that works in the compressed domain. The proposed method is based on both exploiting visual features extracted from the video stream and on using a simple and fast algorithm to detect the video transitions. Experiments on a real-world video dataset with several genres show that our approach presents high accuracy relative to the state-of-the-art solutions and in a computational time that makes it suitable for online usage. © 2011 Springer-Verlag.7042 LNCS7178Universidad de La Frontera (UFRO),The International Association for Pattern Recognition (IAPR),Asociacon Chilena de Reconocimiento de Patrones (AChiRP),Asociacion Cubana de Reconocimiento de Patrones (ACPR),Mex. Assoc. Comput. Vis., Neural Comput. Rob. (MACVNR)Almeida, J., Leite, N.J., Torres, R.S., Comparison of video sequences with histograms of motion patterns (2011) Int. Conf. Image Processing (ICIP 2011)Almeida, J., Minetto, R., Almeida, T.A., Torres, R.S., Leite, N.J., Robust estimation of camera motion using optical flow models (2009) LNCS, 5875, pp. 435-446. , Bebis, G., Boyle, R., Parvin, B., Koracin, D., Kuno, Y., Wang, J., Wang, J.-X., Wang, J., Pajarola, R., Lindstrom, P., Hinkenjann, A., Encarnação, M.L., Silva, C.T., Coming, D. (eds.) ISVC 2009. Springer, HeidelbergAlmeida, J., Minetto, R., Almeida, T.A., Torres, R.S., Leite, N.J., Estimation of camera parameters in video sequences with a large amount of scene motion (2010) Proc. of Int. Conf. Syst. Signals Image (IWSSIP 2010), pp. 348-351Almeida, J., Rocha, A., Torres, R.S., Goldenstein, S., Making colors worth more than a thousand words (2008) Int. Symp. Applied Comput. (ACM SAC 2008), pp. 1180-1186Bezerra, F.N., Leite, N.J., Using string matching to detect video transitions (2007) Pattern Anal. Appl., 10 (1), pp. 45-54Bouch, A., Kuchinsky, A., Bhatti, N.T., Quality is in the eye of the beholder: Meeting users' requirements for internet quality of service (2000) Int. Conf. Human Factors Comput. Syst. (CHI 2000), pp. 297-304Guimarães, S.J.F., Patrocínio Jr., Z.K.G., Paula, H.B., Silva, H.B., A new dissimilarity measure for cut detection using bipartite graph matching (2009) Int. J. Semantic Computing, 3 (2), pp. 155-181Hanjalic, A., Shot-boundary detection: Unraveled and resolved? (2002) IEEE Trans. Circuits Syst. Video Techn., 12 (2), pp. 90-105Koprinska, I., Carrato, S., Temporal video segmentation: A survey (2001) Signal Processing: Image Communication, 16 (5), pp. 477-500Lee, S.W., Kim, Y.M., Choi, S.W., Fast scene change detection using direct feature extraction from MPEG compressed videos (2000) IEEE Trans. Multimedia, 2 (4), pp. 240-254Lienhart, R., Reliable transition detection in videos: A survey and practitioner's guide (2001) Int. J. Image Graphics, 1 (3), pp. 469-486Pei, S.C., Chou, Y.Z., Efficient MPEG compressed video analysis using macroblock type information (1999) IEEE Trans. Multimedia, 1 (4), pp. 321-333Pfeiffer, S., Lienhart, R., Kühne, G., Effelsberg, W., The MoCA project - Movie content analysis research at the University of Mannheim (1998) GI Jahrestagung, pp. 329-338Whitehead, A., Bose, P., Laganière, R., Feature based cut detection with automatic threshold selection (2004) LNCS, 3115, pp. 410-418. , Enser, P.G.B., Kompatsiaris, Y., O'Connor, N.E., Smeaton, A., Smeulders, A.W.M. (eds.) CIVR 2004. Springer, HeidelbergYeo, B.L., Liu, B., Rapid scene analysis on compressed video (1995) IEEE Trans. Circuits Syst. Video Techn., 5 (6), pp. 533-544Zhang, H., Kankanhalli, A., Smoliar, S.W., Automatic partitioning of full-motion video (1993) Multimedia Syst., 1 (1), pp. 10-2