In this paper, we present a method for temporal propagation of depth data that is available for so called key-frames through video sequence. Our method requires that full frame depth information is assigned. Our method utilizes nearest preceding and nearest following key-frames with known depth information. The propagation of depth information from two sides is essential as it allows to solve most occlusion problems correctly. Image matching is based on the coherency sensitive hashing (CSH) method and is done using image pyramids. Disclosed results are compared with temporal interpolation based on motion vectors from optical flow algorithm. The proposed algorithm keeps sharp depth edges of objects even in situations with fast motion or occlusions. It also handles well many situations, when the depth edges don’t perfectly correspond with true edges of objects.

Date Published: 17 March 2015
PDF: 8 pages
Proc. SPIE 9393, Three-Dimensional Image Processing, Measurement (3DIPM), and Applications 2015, 939303 (17 March 2015); doi: 10.1117/12.2078901

Published in SPIE Proceedings Vol. 9393:
Three-Dimensional Image Processing, Measurement (3DIPM), and Applications 2015
Robert Sitnik; William Puech, Editor(s)