OmniViewer: Multi-modal Monoscopic 3D DASH System

3D video is a new form of video featuring omni-view and immersive properties that are beneficial to many applications like telediagnosis, remote physiotherapy and e-learning. In these applications, the data are always multi-modal and highly synchronized. For 2D video streaming, the MPEG group standardized Dynamic Adaptive Streaming over HTTP (DASH) with major transport formats, MPEG-2 TS and ISO Base Media File, including video, audio and subtitle formats. This paper presents OmniViewer, a multi-modal 3D streaming system based DASH, enhancing the versatility of the existing DASH standard and delivery infrastructure such as HTTP servers. Besides 3D video, OmniViewer supports multi-modal media in the DASH content for real-time media-synchronized interactive services. OmniViewer provides a complete multi-modal 3D video streaming solution from recording to rendering through DASH, which fills the gap between monoscopic 3D systems and 3D streaming systems.CNS 10-12194CNS 09-64081Deutsche Telecom Gift fundingOpe