Streaming application of multi-view and free-viewpoint video is potentially attractive but due to the limitation of bandwidth, transmitting all multi-view video in high resolution may not be feasible. Our goal is to propose a new streaming data format that can be adapted to the limited bandwidth and capable of free-viewpoint video streaming using multi-view video plus depth (MVD). Given a requested free-viewpoint, we use the two closest views and corresponding depth maps to perform free-viewpoint video synthesis. We propose a new data format that consists of all views and corresponding depth maps in a lowered resolution, and the two closest views to the requested viewpoint in the high resolution. When the requested viewpoint changes, the two closest viewpoints will change, but one or both of views are transmitted only in the low resolution during the delay time. Therefore, the resolution compensation is required. In this paper, we investigated several cases where one or both of the views are transmitted only in the low resolution. We proposed adequate view synthesis method for multi resolution multi-view video plus depth. Experimental results show that our framework achieves view synthesis quality close to high resolution multi-view video plus depth.

Date Published: 17 March 2015
PDF: 10 pages
Proc. SPIE 9391, Stereoscopic Displays and Applications XXVI, 93911C (17 March 2015); doi: 10.1117/12.2078853

Published in SPIE Proceedings Vol. 9391:
Stereoscopic Displays and Applications XXVI
Nicolas S. Holliman; Andrew J. Woods; Gregg E. Favalora; Takashi Kawai, Editor(s)