Share Email Print

Proceedings Paper

Uncertainties of measures in speaker recognition evaluation
Author(s): Jin Chu Wu; Alvin F. Martin; Craig S. Greenberg; Raghu N. Kacker
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

The National Institute of Standards and Technology (NIST) Speaker Recognition Evaluations (SRE) are an ongoing series of projects conducted by NIST. In the NIST SRE, speaker detection performance is measured using a detection cost function, which is defined as a weighted sum of probabilities of type I error and type II error. The sampling variability can result in measurement uncertainties of the detection cost function. Hence, while evaluating and comparing the performances of speaker recognition systems, the uncertainties of measures must be taken into account. In this article, the uncertainties of detection cost functions in terms of standard errors (SE) and confidence intervals are computed using the nonparametric two-sample bootstrap methods based on our extensive bootstrap variability studies on large datasets conducted before. The data independence is assumed because the bootstrap results of SEs matched very well with the analytical results of SEs using the Mann-Whitney statistic for independent and identically distributed samples if the metric of area under a receiver operating characteristic curve is employed. Examples are provided.

Paper Details

Date Published: 10 May 2011
PDF: 15 pages
Proc. SPIE 8040, Active and Passive Signatures II, 804008 (10 May 2011); doi: 10.1117/12.883252
Show Author Affiliations
Jin Chu Wu, National Institute of Standards and Technology (United States)
Alvin F. Martin, National Institute of Standards and Technology (United States)
Craig S. Greenberg, National Institute of Standards and Technology (United States)
Raghu N. Kacker, National Institute of Standards and Technology (United States)

Published in SPIE Proceedings Vol. 8040:
Active and Passive Signatures II
G. Charmaine Gilbreath; Chadwick Todd Hawley, Editor(s)

© SPIE. Terms of Use
Back to Top