Manipulation and compositing of MC-DCT compressed video

Many advanced video applications require manipulations of compressed video signals. Popular video manipula-tion functions include overlap (opaque or semi-transparent), translation, scaling, linear filtering, rotation, and pixel multiplication. In this paper, we propose algorithms to manipulate compressed video in the compressed domain. Specifically, we focus on compression algorithms using the Discrete Cosine Transform (DCT) with or without Motion Compensation (MC). Compression systems of such kind include JPEG, Motion JPEG, MPEG, and H.261. We derive a complete set of algorithms for all aforementioned manipulation functions in the trans-form domain, in which video signals are represented by quantized transform coefficients. Due to a much lower data rate and the elimination of decompression/compression conversion, the transform-domain approach has great potential in reducing the computational complexity. The actual computational speedup depends on the spe-cific manipulation functions and the compression characteristics of the input video, such as the compression rate and the non-zero motion vector percentage. The proposed techniques can be applied to general orthogonal trans-forms, such as Discrete Trigonometric Transform. For compression systems incorporating MC (such as MPEG), we propose a new decoding algorithm to reconstruct the video in the transform domain and then perform the desired manipulations in the transform domain. The same technique can be applied to efficient video transcodin