Towards automated digital building model generation from floorplans and on-site images

Digitalization of buildings has become increasingly relevant for processes such as construction or refurbishing. However, the lack of availability of digital building models is a common problem. In many cases, only printed floorplans and photos of the interior of a building are available. We propose a system to automatically generate enriched digital models from this data, consisting of two AI modules: one for 3D model reconstruction from 2D plans and one for 6D localization of images taken within a building in the corresponding 3D model. Such a model can facilitate tasks such as monitoring of the condition of a building or defects of its components. We demonstrate this pipeline using a real-world building, from which a plan and pictures of a floor are available, and show that good results can be achieved, with potential to greatly reduce the human effort normally required to create digital twins of buildings