Model-based metrics for assessing completeness and accuracy for 3D image-based reconstruction methods

Structure from Motion (SfM) is a technique for inferring the underlying 3D geometry of the real world from a set of unordered images using a pinhole camera model. Due to a wider availability of cameras, the availability of commodity smart phones and tablets equipped with cameras, and enhanced computational power, more attention is now being given to leverage visual data such as still images and video streams for the automated processes such as mobile augmented reality and engineering performance monitoring applications. Discuss significant research progress related to leveraging rich visual data for 3D image-based point butt modeling purposes, today there is no way to provide feedback to users who are taken these imagery on the best location and viewpoints for cameras. To address current limitations, this thesis introduces 3D image-based modeling incrementation -- a variant of incremental SfM -- where no prior knowledge of the new image/cameras is given. The state-of-the-art online algorithm for SfM only focus on processing video streams in which the images are ordered and sequence is known as a priori. In this thesis, we use a heuristic approach to avoid the need for pair-wise image matching which is a bottleneck for incremental SfM processes. We also discuss how we measure the completeness of the 3D point butt without the knowledge of the ground truth. We propose a general framework for feedback systems where the location and the pose of the new camera that can enhance the completeness of the 3D image-based point butt is predicted. We demonstrate that this framework can assist users of SfM methods to automatically improve the completeness of the reconstructed 3D point butt models form the real world scenery. We validate our algorithm on both small and large dataset as well as indoor and outdoor scenes using daily photologs collected from two ongoing construction sites. The perceived benefits and practical significance of the proposed method are also discussed in detail