Fusion of 3D GIS, Vision, Inertial and Magnetic Data for Improved Urban Pedestrian Navigation and Augmented Reality Applications

n the context of pedestrian navigation and Augmented Reality applications in urban environments, we propose to fuse the pose estimated through a vision process, thanks to a precisely known 3D model, with inertial and magnetic measurements. First, this allows for updating a Pedestrian DeadReckoning process and improving the positioning accuracy. Second, a trusted pose estimate allows us to reproject 3D Geographical Information System content in Augmented Reality with qualified confidence. Because 3D Geographical Information System data are provided by many sources inducing an inhomogeneous precision and level of quality, being able to qualify these 3D contents is important to validate their relevance to use them. A long pedestrian path of 3 km in an urban environment with a sparsely known 3D model of urban furniture was conducted. This has permitted validation of the contribution of sensor fusion that improves the positioning accuracy and allows characterization of the 3D Geographical Information System content directly onsite using Augmented Reality. Performance is presented in terms of positioning accuracy in urban spaces. © 2018 Institute of Navigation