Share Email Print

Proceedings Paper

Adaptive hole filling for 3D warping-based virtual view synthesis
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In this paper, we discuss a Free viewpoint synthesis with View + Depth format for Multiview applications such as 3DTV and Free View-point Television(FTV)1.When generating a virtual image, 3D warping is used with view and depth of a reference camera. This process includes the problem that holes appear in the virtual image. In conventional method, the holes were dealt with collectively by median filter. There are some different reasons why holes appear through this process. So, it is improper that they are not distinguished particularly and treated all at once like conventional method. We analyze the factors, and recognize that two ones exist, boundary between foreground and background, and reduction of resolution. In this paper, we propose a new hole filling method considering these factors. In the first step, we classify nearby pixels into boundary or same object area according to the gradient of depth value. For boundary case, we hold them and refer to other two real cameras. For another case of same object area, we set up sub-pixels between nearby pixels and warp them if the depth is gradually changing or virtual viewpoint of the warped image is closer to the object than the original view position because they probably cause holes from reduction of resolution. We implement these methods in the simulation. As a result, we prevent boundary in the virtual image from being ambiguous, and confirm the availability of proposed method.

Paper Details

Date Published: 12 March 2013
PDF: 9 pages
Proc. SPIE 8648, Stereoscopic Displays and Applications XXIV, 864823 (12 March 2013); doi: 10.1117/12.2002830
Show Author Affiliations
Tatsuro Mori, Nagoya Univ. (Japan)
Mehrdad Panahpour Tehrani, National Institute of Information and Communications Technology (Japan)
Toshiaki Fujii, Nagoya Univ. (Japan)
Masayuki Tanimoto, Nagoya Industrial Science Research Institute (Japan)

Published in SPIE Proceedings Vol. 8648:
Stereoscopic Displays and Applications XXIV
Andrew J. Woods; Nicolas S. Holliman; Gregg E. Favalora, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?