Real time 3D and heterogeneous data fusion

This project visualizes characterization data in a 3D setting, in real time. Real time in this sense means collecting the data and presenting it before it delays the user, and processing faster than the acquisition systems so no bottlenecks occur. The goals have been to build a volumetric viewer to display 3D data, demonstrate projecting other data, such as images, onto the 3D data, and display both the 3D and projected images as fast as the data became available. The authors have examined several ways to display 3D surface data. The most effective was generating polygonal surface meshes. They have created surface maps form a continuous stream of 3D range data, fused image data onto the geometry, and displayed the data with a standard 3D rendering package. In parallel with this, they have developed a method to project real-time images onto the surface created. A key component is mapping the data on the correct surfaces, which requires a-priori positional information along with accurate calibration of the camera and lens system