Share Email Print
cover

Proceedings Paper

Bayesian surprise metric for outlier detection in on-line learning
Author(s): Erion Hasanbelliu; Kittipat Kampa; James T. Cobb; José C. Príncipe
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

Our previous work developed an online learning Bayesian framework (dynamic tree) for data organization and clustering. To continuously adapt the system during operation, we concurrently seek to perform outlier detection to prevent them from incorrectly modifying the system. We propose a new Bayesian surprise metric to differentiate outliers from the training data and thus help to selectively adapt the model parameters. The metric is calculated based on the difference between the prior and the posterior distributions on the model when a new sample is introduced. A good training datum would sufficiently but not excessively change the model; consequently, the difference between the prior and the posterior distributions would be reasonable to the amount of new information present on the datum. However, an outlier carries an element of surprise that would significantly change the model. In such a case, the posterior distribution would greatly differ from the prior resulting in a large value for the surprise metric. We categorize this datum as an outlier and other means (e.g. human operator) will have to be used to handle such cases. The surprise metric is calculated based on the model distribution, and as such, it adapts with the model. The surprise factor is dependent on the state of the system. This speeds up the learning process by considering only the relevant new data. Both the model parameters and even the structure of the dynamic tree can be updated under this approach.

Paper Details

Date Published: 23 May 2011
PDF: 12 pages
Proc. SPIE 8017, Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XVI, 80170S (23 May 2011); doi: 10.1117/12.883662
Show Author Affiliations
Erion Hasanbelliu, Univ. of Florida (United States)
Kittipat Kampa, Univ. of Florida (United States)
James T. Cobb, Naval Surface Warfare Ctr., Panama City Div. (United States)
José C. Príncipe, Univ. of Florida (United States)


Published in SPIE Proceedings Vol. 8017:
Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XVI
Russell S. Harmon; John H. Holloway; J. Thomas Broach, Editor(s)

© SPIE. Terms of Use
Back to Top