Share Email Print

Proceedings Paper

Real-time EO/IR sensor fusion on a portable computer and head-mounted display
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Multi-sensor platforms are widely used in surveillance video systems for both military and civilian applications. The complimentary nature of different types of sensors (e.g. EO and IR sensors) makes it possible to observe the scene under almost any condition (day/night/fog/smoke). In this paper, we propose an innovative EO/IR sensor registration and fusion algorithm which runs real-time on a portable computing unit with head-mounted display. The EO/IR sensor suite is mounted on a helmet for a dismounted soldier and the fused scene is shown in the goggle display upon the processing on a portable computing unit. The linear homography transformation between images from the two sensors is precomputed for the mid-to-far scene, which reduces the computational cost for the online calibration of the sensors. The system is implemented in a highly optimized C++ code, with MMX/SSE, and performing a real-time registration. The experimental results on real captured video show the system works very well both in speed and in performance.

Paper Details

Date Published: 9 April 2007
PDF: 8 pages
Proc. SPIE 6571, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2007, 657106 (9 April 2007);
Show Author Affiliations
Zhanfeng Yue, FastVDO, LLC (United States)
Pankaj Topiwala, FastVDO, LLC (United States)

Published in SPIE Proceedings Vol. 6571:
Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2007
Belur V. Dasarathy, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?