Share Email Print

Optical Engineering

Novel view synthesis by interpolation over sparse examples
Author(s): Bodong Liang; Ronald Chi-kit Chung
Format Member Price Non-Member Price
PDF $20.00 $25.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Novel view synthesis (NVS) is an important problem in image rendering. It involves synthesizing an image of a scene at any specified (novel) viewpoint, given some images of the scene at a few sample viewpoints. The general understanding is that the solution should bypass explicit 3-D reconstruction of the scene. As it is, the problem has a natural tie to interpolation, despite that mainstream efforts on the problem have been adopting formulations otherwise. Interpolation is about finding the output of a function f(x) for any specified input x, given a few input-output pairs {(xi,fi):i=1,2,3,...,n} of the function. If the input x is the viewpoint, and f(x) is the image, the interpolation problem becomes exactly NVS. We treat the NVS problem using the interpolation formulation. In particular, we adopt the example-based everything or interpolation (EBI) mechanism—an established mechanism for interpolating or learning functions from examples. EBI has all the desirable properties of a good interpolation: all given input-output examples are satisfied exactly, and the interpolation is smooth with minimum oscillations between the examples. We point out that EBI, however, has difficulty in interpolating certain classes of functions, including the image function in the NVS problem. We propose an extension of the mechanism for overcoming the limitation. We also present how the extended interpolation mechanism could be used to synthesize images at novel viewpoints. Real image results show that the mechanism has promising performance, even with very few example images.

Paper Details

Date Published: 1 January 2006
PDF: 15 pages
Opt. Eng. 45(1) 017202 doi: 10.1117/1.2158392
Published in: Optical Engineering Volume 45, Issue 1
Show Author Affiliations
Bodong Liang, The Chinese Univ. of Hong Kong (Hong Kong China)
Ronald Chi-kit Chung, The Chinese Univ. of Hong Kong (Hong Kong China)

© SPIE. Terms of Use
Back to Top