Simultaneous Camera Pose and Correspondence Estimation in Cornerless Images

We propose an algorithm which can jointly estimate camera pose and point set registration. Given point sets from two views of a stationary scene, our algorithm regis-ters the point sets while retaining internal scene structure. It simultaneously ensures that the resultant registration is consistent with that of a moving camera viewing a static scene (adheres to some epipolar constraint). Our statisti-cal formulation can incorporate but does not necessarily require additional constraints such as brightness constancy and high dimensional point descriptors such as SIFT. We show that our algorithm is stable over a variety of scenes and offers a pose from edge system which handles currently difficult structure from motion scenes more robustly. 1