Alignment of non-overlapping sequences

This paper shows how two image sequences that have no spatial overlap between their$elds of view can be aligned both in time and in space. Such alignment is possible when the two cameras are attached closely together and are moved jointly in space. The common motion induces “similar ” changes over time within the two sequences. This correlated temporal behaviol; is used to recover the spatial and temporal transformations between the two sequences. The requirement of “coherent appearance ” in standard im-age alignment techniques is therefore replaced by “coherent temporal behavior”, which is often easier to satisb. This approach to alignment can be used not only f o r aligning non-overlapping sequences, but also f o r handling other cases that are inherently dificult f o r standard im-age alignment techniques. We demonstrate applications of this approach to three real-world problems: ( i) alignment of non-overlapping sequences f o r generating wide-screen movies, ( i i) alignment of images (sequences) obtained at sign$cantly different zooms, f o r surveillance applications, and, ( i i i) multi-sensor image alignment f o r multi-sensor fir-sion.