Uncalibrated stereo rectification for automatic 3D surveillance

We describe a stereo rectification method suitable for automatic 3D surveillance. We take advantage of the fact that in a typical ur-ban scene, there is ordinarily a small number of dominant planes. Given two views of the scene, we align a dominant plane in one view with the other. Conjugate epipolar lines between the refer-ence view and plane-aligned image become geometrically identi-cal and can be added to the rectified image pair line by line. Select-ing conjugate epipolar lines to cover the whole image is simplified since they are geometrically identical. In addition, the polarities of conjugate epipolar lines are automatically preserved by plane alignment, which simplifies stereo matching. 1