Share Email Print

Proceedings Paper

Mosaics from MPEG-2 video
Author(s): Mark A. Robertson; Thomas S. Heath
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Construction of panoramic mosaics from video is well established in both the research and commercial communities, but current methods generally perform the time-consuming registration procedure entirely from the sequence's pixel data. Video sequences usually exist in compressed format, often MPEG-2; while specialized hardware and highly-optimized software can often quickly create accurate mosaics from a video sequence's pixels, these products do not make efficient use of all information available in a compressed video stream. In particular, MPEG video files generally contain significant information about global camera motion in their motion vectors. This paper describes how to exploit the motion vector information so that global motion can be estimated extremely quickly and accurately, which leads to accurate panoramic mosaics. The major obstacle in generating mosaics with this method is variable quality of MPEG motion vectors, both within a stream from a particular MPEG encoder and between streams compressed with different encoders. The paper discusses methods of robustly estimating global camera motion from the observed motion vectors, including the use of least absolute value estimators, variable model order for global camera motion, and motion vector weighting depending on their estimated accuracy. Experimental results are presented to demonstrate the performance of the algorithm.

Paper Details

Date Published: 1 July 2003
PDF: 12 pages
Proc. SPIE 5016, Computational Imaging, (1 July 2003); doi: 10.1117/12.479706
Show Author Affiliations
Mark A. Robertson, Air Force Research Lab. (United States)
Thomas S. Heath, Northrop Grumman Corp. (United States)

Published in SPIE Proceedings Vol. 5016:
Computational Imaging
Charles A. Bouman; Robert L. Stevenson, Editor(s)

© SPIE. Terms of Use
Back to Top