Share Email Print

Proceedings Paper

On analyzing free-response data on location level
Author(s): Andriy I. Bandos; Nancy A. Obuchowski
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Free-response ROC (FROC) data are typically collected when primary question of interest is focused on the proportions of the correct detection-localization of known targets and frequencies of false positive responses, which can be multiple per subject (image). These studies are particularly relevant for CAD and related applications. The fundamental tool of the location-level FROC analysis is the FROC curve. Although there are many methods of FROC analysis, as we describe in this work, some of the standard and popular approaches, while important, are not suitable for analyzing specifically the location-level FROC performance as summarized by the FROC curve. Analysis of the FROC curve, on the other hand, might not be straightforward. Recently we developed an approach for the location-level analysis of the FROC data using the well-known tools for clustered ROC analysis. In the current work, based on previously developed concepts, and using specific examples, we demonstrate the key reasons why specifically location-level FROC performance cannot be fully addressed by the common approaches as well as illustrate the proposed solution. Specifically, we consider the two most salient FROC approaches, namely JAFROC and the area under the exponentially transformed FROC curve (AFE) and show that clearly superior FROC curves can have lower values for these indices. We describe the specific features that make these approaches inconsistent with FROC curves. This work illustrates some caveats for using the common approaches for location-level FROC analysis and provides guidelines for the appropriate assessment or comparison of FROC systems.

Paper Details

Date Published: 10 March 2017
PDF: 9 pages
Proc. SPIE 10136, Medical Imaging 2017: Image Perception, Observer Performance, and Technology Assessment, 1013616 (10 March 2017); doi: 10.1117/12.2267007
Show Author Affiliations
Andriy I. Bandos, Univ. of Pittsburgh (United States)
Nancy A. Obuchowski, Cleveland Clinic Foundation (United States)

Published in SPIE Proceedings Vol. 10136:
Medical Imaging 2017: Image Perception, Observer Performance, and Technology Assessment
Matthew A. Kupinski; Robert M. Nishikawa, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?