Share Email Print

Proceedings Paper

Optimal detection of objects in images and videos using electroencephalography (EEG)
Author(s): Deepak Khosla; Rajan Bhattacharyya; Penn Tasinga; David J. Huber
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The Rapid Serial Visual Presentation (RSVP) protocol for EEG has recently been discovered as a useful tool for highthroughput filtering of images into simple target and nontarget categories [1]. This concept can be extended to the detection of objects and anomalies in images and videos that are of interest to the user (observer) in an applicationspecific context. For example, an image analyst looking for a moving vehicle in wide-area imagery will consider such an object to be target or Item Of Interest (IOI). The ordering of images in the RSVP sequence is expected to have an impact on the detection accuracy. In this paper, we describe an algorithm for learning the RSVP ordering that employs a user interaction step to maximize the detection accuracy while simultaneously minimizing false alarms. With user feedback, the algorithm learns the optimal balance of image distance metrics in order to closely emulate the human's own preference for image order. It then employs the fusion of various perceptual and bio-inspired image metrics to emulate the human's sequencing ability for groups of image chips, which are subsequently used in RSVP trials. Such a method can be employed in human-assisted threat assessment in which the system must scan a wide field of view and report any detections or anomalies to the landscape. In these instances, automated classification methods might fail. We will describe the algorithm and present preliminary results on real-world imagery.

Paper Details

Date Published: 5 May 2011
PDF: 11 pages
Proc. SPIE 8050, Signal Processing, Sensor Fusion, and Target Recognition XX, 80501C (5 May 2011); doi: 10.1117/12.883586
Show Author Affiliations
Deepak Khosla, HRL Labs., LLC (United States)
Rajan Bhattacharyya, HRL Labs., LLC (United States)
Penn Tasinga, HRL Labs., LLC (United States)
David J. Huber, HRL Labs., LLC (United States)

Published in SPIE Proceedings Vol. 8050:
Signal Processing, Sensor Fusion, and Target Recognition XX
Ivan Kadar, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?