Share Email Print

Proceedings Paper

Low-power, real-time digital video stabilization using the HyperX parallel processor
Author(s): Martin A. Hunt; Lin Tong; Keith Bindloss; Shang Zhong; Steve Lim; Benjamin J. Schmid; J. Daniel Tidwell; Paul D. Willson
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Coherent Logix has implemented a digital video stabilization algorithm for use in soldier systems and small unmanned air / ground vehicles that focuses on significantly reducing the size, weight, and power as compared to current implementations. The stabilization application was implemented on the HyperX architecture using a dataflow programming methodology and the ANSI C programming language. The initial implementation is capable of stabilizing an 800 x 600, 30 fps, full color video stream with a 53ms frame latency using a single 100 DSP core HyperX hx3100TM processor running at less than 3 W power draw. By comparison an Intel Core2 Duo processor running the same base algorithm on a 320x240, 15 fps stream consumes on the order of 18W. The HyperX implementation is an overall 100x improvement in performance (processing bandwidth increase times power improvement) over the GPP based platform. In addition the implementation only requires a minimal number of components to interface directly to the imaging sensor and helmet mounted display or the same computing architecture can be used to generate software defined radio waveforms for communications links. In this application, the global motion due to the camera is measured using a feature based algorithm (11 x 11 Difference of Gaussian filter and Features from Accelerated Segment Test) and model fitting (Random Sample Consensus). Features are matched in consecutive frames and a control system determines the affine transform to apply to the captured frame that will remove or dampen the camera / platform motion on a frame-by-frame basis.

Paper Details

Date Published: 5 May 2011
PDF: 14 pages
Proc. SPIE 8050, Signal Processing, Sensor Fusion, and Target Recognition XX, 80501T (5 May 2011); doi: 10.1117/12.884390
Show Author Affiliations
Martin A. Hunt, Coherent Logix, Inc. (United States)
Lin Tong, Coherent Logix, Inc. (United States)
Keith Bindloss, Coherent Logix, Inc. (United States)
Shang Zhong, Coherent Logix, Inc. (United States)
Steve Lim, Coherent Logix, Inc. (United States)
Benjamin J. Schmid, U.S. Army RDECOM AMRDEC (United States)
J. Daniel Tidwell, U.S. Army RDECOM AMRDEC (United States)
Paul D. Willson, U.S. Army RDECOM ARDEC (United States)

Published in SPIE Proceedings Vol. 8050:
Signal Processing, Sensor Fusion, and Target Recognition XX
Ivan Kadar, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?