Analysis and compensation of rolling shutter effect

Abstract—Due to the sequential-readout structure of comple-mentary metal-oxide semiconductor image sensor array, each scanline of the acquired image is exposed at a different time, resulting in the so-called electronic rolling shutter that induces geometric image distortion when the object or the video camera moves during image capture. In this paper, we propose an image processing technique using a planar motion model to address the problem. Unlike previous methods that involve complex 3-D feature correspondences, a simple approach to the analysis of inter- and intraframe distortions is presented. The high-resolution velocity estimates used for restoring the image are obtained by global motion estimation, Bézier curve fitting, and local motion estimation without resort to correspondence identification. Exper-imental results demonstrate the effectiveness of the algorithm. Index Terms—Complementary metal-oxide semiconductor (CMOS) sensor array, motion analysis, rolling shutter. I