Share Email Print

Proceedings Paper

High precision object segmentation and tracking for use in super resolution video reconstruction
Author(s): T. Nathan Mundhenk; Rashmi Sundareswara; David R. Gerwe; Yang Chen
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

Super resolution image reconstruction allows for the enhancement of images in a video sequence that is superior to the original pixel resolution of the imager. Difficulty arises when there are foreground objects that move differently than the background. A common example of this is a car in motion in a video. Given the common occurrence of such situations, super resolution reconstruction becomes non-trivial. One method for dealing with this is to segment out foreground objects and quantify their pixel motion differently. First we estimate local pixel motion using a standard block motion algorithm common to MPEG encoding. This is then combined with the image itself into a five dimensional mean-shift kernel density estimation based image segmentation with mixed motion and color image feature information. This results in a tight segmentation of objects in terms of both motion and visible image features. The next step is to combine segments into a single master object. Statistically common motion and proximity are used to merge segments into master objects. To account for inconsistencies that can arise when tracking objects, we compute statistics over the object and fit it with a generalized linear model. Using the Kullback-Leibler divergence, we have a metric for the goodness of the track for an object between frames.

Paper Details

Date Published: 24 January 2011
PDF: 13 pages
Proc. SPIE 7878, Intelligent Robots and Computer Vision XXVIII: Algorithms and Techniques, 78780G (24 January 2011); doi: 10.1117/12.871605
Show Author Affiliations
T. Nathan Mundhenk, HRL Labs., LLC (United States)
Rashmi Sundareswara, HRL Labs., LLC (United States)
David R. Gerwe, Boeing Corp. (United States)
Yang Chen, HRL Labs., LLC (United States)

Published in SPIE Proceedings Vol. 7878:
Intelligent Robots and Computer Vision XXVIII: Algorithms and Techniques
Juha Röning; David P. Casasent; Ernest L. Hall, Editor(s)

© SPIE. Terms of Use
Back to Top