Share Email Print

Proceedings Paper

Content-based 3D mosaics for dynamic urban scenes
Author(s): Zhigang Zhu; Hao Tang; George Wolberg; Jeffery R. Layne
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

We propose a content-based 3D mosaic (CB3M) representation for long video sequences of 3D and dynamic scenes captured by a camera on a mobile platform. The motion of the camera has a dominant direction of motion (as on an airplane or ground vehicle), but 6 DOF motion is allowed. In the first step, a set of parallel-perspective (pushbroom) mosaics with varying viewing directions is generated to capture both the 3D and dynamic aspects of the scene under the camera coverage. In the second step, a segmentation-based stereo matching algorithm is applied to extract parametric representations of the color, structure and motion of the dynamic and/or 3D objects in urban scenes where a lot of planar surfaces exist. Multiple pairs of stereo mosaics are used for facilitating reliable stereo matching, occlusion handling, accurate 3D reconstruction and robust moving target detection. We use the fact that all the static objects obey the epipolar geometry of pushbroom stereo, whereas an independent moving object either violates the epipolar geometry if the motion is not in the direction of sensor motion or exhibits unusual 3D structures. The CB3M is a highly compressed visual representation for a very long video sequence of a dynamic 3D scene. More importantly, the CB3M representation has object contents of both 3D and motion. Experimental results are given for the CB3M construction for both simulated and real video sequences to show the accuracy and effectiveness of the representation.

Paper Details

Date Published: 9 May 2006
PDF: 12 pages
Proc. SPIE 6229, Intelligent Computing: Theory and Applications IV, 62290M (9 May 2006); doi: 10.1117/12.664200
Show Author Affiliations
Zhigang Zhu, City College of New York (United States)
Hao Tang, City College of New York (United States)
George Wolberg, City College of New York (United States)
Jeffery R. Layne, Air Force Research Lab. (United States)

Published in SPIE Proceedings Vol. 6229:
Intelligent Computing: Theory and Applications IV
Kevin L. Priddy; Emre Ertin, Editor(s)

© SPIE. Terms of Use
Back to Top