Share Email Print

Journal of Electronic Imaging

Image-guided depth propagation for 2-D-to-3-D video conversion using superpixel matching and adaptive autoregressive model
Author(s): Jiji Cai; Cheolkon Jung
Format Member Price Non-Member Price
PDF $20.00 $25.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

We propose image-guided depth propagation for two-dimensional (2-D)-to-three-dimensional (3-D) video conversion using superpixel matching and the adaptive autoregressive (AR) model. We adopt key frame-based depth propagation that propagates the depth map in the key frame to nonkey frames. Moreover, we use the adaptive AR model for depth refinement to penalize depth-color inconsistency. First, we perform superpixel matching to estimate motion vectors at the superpixel level instead of block matching based on the fixed block size. Then, we conduct depth compensation based on motion vectors to generate the depth map in the nonkey frame. However, the size of two superpixels is not exactly the same due to the segment-based matching, which causes matching errors in the compensated depth map. Thus, we introduce an adaptive image-guided AR model to minimize matching errors and produce the final depth map by minimizing AR prediction errors. Finally, we employ depth-image-based rendering to generate stereoscopic views from 2-D videos and their depth maps. Experimental results demonstrate that the proposed method successfully performs depth propagation and produces high-quality depth maps for 2-D-to-3-D video conversion.

Paper Details

Date Published: 10 October 2017
PDF: 8 pages
J. Electron. Imag. 26(5) 053019 doi: 10.1117/1.JEI.26.5.053019
Published in: Journal of Electronic Imaging Volume 26, Issue 5
Show Author Affiliations
Jiji Cai, Xidian Univ. (China)
Cheolkon Jung, Xidian Univ. (China)

© SPIE. Terms of Use
Back to Top