3D rendering and interaction in an augmented reality mobile system

Augmented Reality(AR) is a concept that is getting more and more popular, and the number of applications using it is increasing. AR applications include several concepts such as image recognition and camera calibration, together known as tracking, and it also uses 2D and 3D graphics rendering. The most important and difficult part of AR applications is the tracking, where an object not only should be recognized in many different conditions, but it should also be determined how the object is viewed upon. This report describes how the task given by BMW Group in Shanghai was solved, which was to create an iPhone prototype AR application, that should be able to recognize objects inside of a car and be able to interact with them through the mobile phone. The report explains the implemented solution to this problem, what different recognition methods were tested and the different ways of creating the 3D graphics overlay that was evaluated. The AR application resulted in a functional AR application capable of recognizing the determined objects, draw their corresponding 3D representations and interact with them. However, the application was not complete as camera calibration was not used and a connection between the mobile phone andthe car was never established