Share Email Print
cover

Proceedings Paper

Multi-order analysis framework for comprehensive biometric performance evaluation
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

It is not uncommon for contemporary biometric systems to have more than one match below the matching threshold, or to have two or more matches having close matching scores. This is especially true for those that store large quantities of identities and/or are applied to measure loosely constrained biometric traits, such as in identification from video or at a distance. Current biometric performance evaluation standards however are still largely based on measuring single-score statistics such as False Match, False Non-Match rates and the trade-off curves based thereon. Such methodology and reporting makes it impossible to investigate the risks and risk mitigation strategies associated with not having a unique identifying score. To address the issue, Canada Border Services Agency has developed a novel modality-agnostic multi-order performance analysis framework. The framework allows one to analyze the system performance at several levels of detail, by defining the traditional single-score-based metrics as Order-1 analysis, and introducing Order- 2 and Order-3 analysis to permit the investigation of the system reliability and the confidence of its recognition decisions. Implemented in a toolkit called C-BET (Comprehensive Biometrics Evaluation Toolkit), the framework has been applied in a recent examination of the state-of-the art iris recognition systems, the results of which are presented, and is now recommended to other agencies interested in testing and tuning the biometric systems.

Paper Details

Date Published: 14 April 2010
PDF: 12 pages
Proc. SPIE 7667, Biometric Technology for Human Identification VII, 76670G (14 April 2010); doi: 10.1117/12.849801
Show Author Affiliations
Dmitry O. Gorodnichy, Canada Border Services Agency (Canada)


Published in SPIE Proceedings Vol. 7667:
Biometric Technology for Human Identification VII
B. V. K. Vijaya Kumar; Salil Prabhakar; Arun A. Ross, Editor(s)

© SPIE. Terms of Use
Back to Top