A Photo-Realistic Driving Simulation System for Mixed-Reality Traffic Experiment Space

Abstract — In this paper, we propose an efficient and effective image generation system for “Mixed Reality Traffic Experiment Space”, an enhanced driving/traffic simulation system which we have been developing for Sustainable ITS project at the University of Tokyo. Conventional driving simulators represent ther view by a set of polygon-based objects, which leads to less photo-reality and huge human costs for dataset construction. We introduce our image/geometry-based hybrid method to realize more photo-realistic view with less human cost at the same time. Images for datesets are captured from real world by multiple video cameras mounted on a data acquisition vehicle. And the view for the system is created by synthesizing the image dataset. Following contents mainly describe details on data acquisition and view rendering. I