Share Email Print

Proceedings Paper

Forward looking anomaly detection via fusion of infrared and color imagery
Author(s): K. Stone; J. M. Keller; M. Popescu; T. C. Havens; K. C. Ho
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

This paper develops algorithms for the detection of interesting and abnormal objects in color and infrared imagery taken from cameras mounted on a moving vehicle, observing a fixed scene. The primary purpose of detection is to cue a human-in-the-loop detection system. Algorithms for direct detection and change detection are investigated, as well as fusion of the two. Both methods use temporal information to reduce the number of false alarms. The direct detection algorithm uses image self-similarity computed between local neighborhoods to determine interesting, or unique, parts of an image. Neighborhood similarity is computed using Euclidean distance in CIELAB color space for the color imagery, and Euclidean distance between grey levels in the infrared imagery. The change detection algorithm uses the affine scale-invariant feature transform (ASIFT) to transform multiple background frames into the current image space. Each transformed image is then compared to the current image, and the multiple outputs are fused to produce a single difference image. Changes in lighting and contrast between the background run and the current run are adjusted for in both color and infrared imagery. Frame-to-frame motion is modeled using a perspective transformation, the parameters of which are computed using scale-invariant feature transform (SIFT) keypoint correspondences. This information is used to perform temporal accumulation of single frame detections for both the direct detection and change detection algorithms. Performance of the proposed algorithms is evaluated on multiple lanes from a data collection at a US Army test site.

Paper Details

Date Published: 29 April 2010
PDF: 12 pages
Proc. SPIE 7664, Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XV, 766425 (29 April 2010); doi: 10.1117/12.851370
Show Author Affiliations
K. Stone, Univ. of Missouri-Columbia (United States)
J. M. Keller, Univ. of Missouri-Columbia (United States)
M. Popescu, Univ. of Missouri-Columbia (United States)
T. C. Havens, Univ. of Missouri-Columbia (United States)
K. C. Ho, Univ. of Missouri-Columbia (United States)

Published in SPIE Proceedings Vol. 7664:
Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XV
Russell S. Harmon; John H. Holloway Jr.; J. Thomas Broach, Editor(s)

© SPIE. Terms of Use
Back to Top