Share Email Print

Proceedings Paper

Developing a clinical utility framework to evaluate prediction models in radiogenomics
Author(s): Yirong Wu; Jie Liu; Alejandro Munoz del Rio; David C. Page; Oguzhan Alagoz; Peggy Peissig; Adedayo A. Onitilo; Elizabeth S. Burnside M.D.
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Combining imaging and genetic information to predict disease presence and behavior is being codified into an emerging discipline called “radiogenomics.” Optimal evaluation methodologies for radiogenomics techniques have not been established. We aim to develop a clinical decision framework based on utility analysis to assess prediction models for breast cancer. Our data comes from a retrospective case-control study, collecting Gail model risk factors, genetic variants (single nucleotide polymorphisms-SNPs), and mammographic features in Breast Imaging Reporting and Data System (BI-RADS) lexicon. We first constructed three logistic regression models built on different sets of predictive features: (1) Gail, (2) Gail+SNP, and (3) Gail+SNP+BI-RADS. Then, we generated ROC curves for three models. After we assigned utility values for each category of findings (true negative, false positive, false negative and true positive), we pursued optimal operating points on ROC curves to achieve maximum expected utility (MEU) of breast cancer diagnosis. We used McNemar’s test to compare the predictive performance of the three models. We found that SNPs and BI-RADS features augmented the baseline Gail model in terms of the area under ROC curve (AUC) and MEU. SNPs improved sensitivity of the Gail model (0.276 vs. 0.147) and reduced specificity (0.855 vs. 0.912). When additional mammographic features were added, sensitivity increased to 0.457 and specificity to 0.872. SNPs and mammographic features played a significant role in breast cancer risk estimation (p-value < 0.001). Our decision framework comprising utility analysis and McNemar’s test provides a novel framework to evaluate prediction models in the realm of radiogenomics.

Paper Details

Date Published: 17 March 2015
PDF: 8 pages
Proc. SPIE 9416, Medical Imaging 2015: Image Perception, Observer Performance, and Technology Assessment, 941617 (17 March 2015); doi: 10.1117/12.2081954
Show Author Affiliations
Yirong Wu, Univ. of Wisconsin-Madison (United States)
Jie Liu, Univ. of Wisconsin-Madison (United States)
Alejandro Munoz del Rio, Univ. of Wisconsin-Madison (United States)
David C. Page, Univ. of Wisconsin-Madison (United States)
Oguzhan Alagoz, Univ. of Wisconsin-Madison (United States)
Peggy Peissig, Marshfield Clinic (United States)
Adedayo A. Onitilo, Marshfield Clinic (United States)
Elizabeth S. Burnside M.D., Univ. of Wisconsin-Madison (United States)

Published in SPIE Proceedings Vol. 9416:
Medical Imaging 2015: Image Perception, Observer Performance, and Technology Assessment
Claudia R. Mello-Thoms; Matthew A. Kupinski, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?