Share Email Print

Proceedings Paper

Mixed-resolution view synthesis using non-local means refined image merging
Author(s): Thomas Richter; Michael Schöberl; Jürgen Seiler; Tobias Tröger; André Kaup
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Synthesizing novel views from originally available camera perspectives via depth maps is a key issue in the 3D video domain. Up to now, several high-resolution cameras are needed to obtain high-quality intermediate synthesized views. One possibility to reduce costs with regard to the used camera array is to replace some cameras by low-resolution cameras, which are cheaper on the one hand, but provide a much poorer image quality on the other hand. Unfortunately, some of the information inside the desired intermediate view may only be available in the low-resolution reference. Thus, the image quality of the low-resolution reference has a big influence on the visual quality of the synthesized view. This paper proposes a postprocessing step for the synthesized view, based on the non-local means algorithm. Thereby, all areas inserted from the low-resolution reference get efficiently adapted to their high-resolution environment. It is shown, that the non-local means refined image merging leads to a PSNR gain of up to 0.90 dB compared to an unrefined mixed-resolution setup. The approach can be easily extended to a hole-filling algorithm and yields a PSNR gain of up to 0.81 dB for hole areas compared to a reference hole-filling algorithm. The subjective image quality also increases convincingly in both applications.

Paper Details

Date Published: 25 February 2012
PDF: 10 pages
Proc. SPIE 8288, Stereoscopic Displays and Applications XXIII, 82881K (25 February 2012); doi: 10.1117/12.906552
Show Author Affiliations
Thomas Richter, Friedrich-Alexander-Univ. Erlangen-Nürnberg (Germany)
Michael Schöberl, Friedrich-Alexander-Univ. Erlangen-Nürnberg (Germany)
Jürgen Seiler, Friedrich-Alexander-Univ. Erlangen-Nürnberg (Germany)
Tobias Tröger, Friedrich-Alexander-Univ. Erlangen-Nürnberg (Germany)
André Kaup, Friedrich-Alexander-Univ. Erlangen-Nürnberg (Germany)

Published in SPIE Proceedings Vol. 8288:
Stereoscopic Displays and Applications XXIII
Andrew J. Woods; Nicolas S. Holliman; Gregg E. Favalora, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?