Share Email Print

Proceedings Paper

Novel view synthesis with residual error feedback for FTV
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

The availability of multi-view images of a scene makes possible new and exciting applications, including Free-viewpoint TV (FTV). FTV allows us to change viewpoint freely in a 3D world, where the virtual viewpoint images are synthesized by Depth-Image-Based Rendering (DIBR). In this paper, we propose a new method of DIBR using multi-view images acquired in a linear camera arrangement. The proposed method improves virtual viewpoint images by predicting the residual errors. For virtual viewpoint image synthesis, it is necessary to estimate the depth maps with multi-view images. Some algorithms to estimate depth map were proposed, but it is difficult to estimate accurate depth map. As a result, rendered virtual viewpoint images have some errors due to the depth errors. Therefore, our proposed method takes into account those depth errors and improves the quality of the rendered virtual viewpoint images. In the proposed method, the virtual images of each camera position are generated using the real images from each other camera. Then, the residual errors can be calculated between the generated images and the real images acquired by the actual cameras. The residual errors are processed and fed back to predict the residual errors that can be happened to virtual viewpoint images generated by conventional method. In the experiments, PSNR could be improved for few decibels compared with the conventional method.

Paper Details

Date Published: 18 February 2010
PDF: 12 pages
Proc. SPIE 7524, Stereoscopic Displays and Applications XXI, 75240K (18 February 2010); doi: 10.1117/12.839110
Show Author Affiliations
Hisayoshi Furihata, Nagoya Univ. (Japan)
Tomohiro Yendo, Nagoya Univ. (Japan)
Mehrdad Panahpour Tehrani, Nagoya Univ. (Japan)
Toshiaki Fujii, Tokyo Institute of Technology (Japan)
Masayuki Tanimoto, Nagoya Univ. (Japan)

Published in SPIE Proceedings Vol. 7524:
Stereoscopic Displays and Applications XXI
Andrew J. Woods; Nicolas S. Holliman; Neil A. Dodgson, Editor(s)

© SPIE. Terms of Use
Back to Top