Share Email Print

Proceedings Paper

Training set optimization and classifier performance in a top-down diabetic retinopathy screening system
Author(s): J. Wigdahl; C. Agurto; V. Murray; S. Barriga; P. Soliz
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Diabetic retinopathy (DR) affects more than 4.4 million Americans age 40 and over. Automatic screening for DR has shown to be an efficient and cost-effective way to lower the burden on the healthcare system, by triaging diabetic patients and ensuring timely care for those presenting with DR. Several supervised algorithms have been developed to detect pathologies related to DR, but little work has been done in determining the size of the training set that optimizes an algorithm’s performance. In this paper we analyze the effect of the training sample size on the performance of a top-down DR screening algorithm for different types of statistical classifiers. Results are based on partial least squares (PLS), support vector machines (SVM), k-nearest neighbor (kNN), and Naïve Bayes classifiers. Our dataset consisted of digital retinal images collected from a total of 745 cases (595 controls, 150 with DR). We varied the number of normal controls in the training set, while keeping the number of DR samples constant, and repeated the procedure 10 times using randomized training sets to avoid bias. Results show increasing performance in terms of area under the ROC curve (AUC) when the number of DR subjects in the training set increased, with similar trends for each of the classifiers. Of these, PLS and k-NN had the highest average AUC. Lower standard deviation and a flattening of the AUC curve gives evidence that there is a limit to the learning ability of the classifiers and an optimal number of cases to train on.

Paper Details

Date Published: 18 March 2013
PDF: 8 pages
Proc. SPIE 8670, Medical Imaging 2013: Computer-Aided Diagnosis, 86702K (18 March 2013); doi: 10.1117/12.2007931
Show Author Affiliations
J. Wigdahl, VisionQuest Biomedical, LLC (United States)
Univ. of New Mexico (United States)
C. Agurto, VisionQuest Biomedical, LLC (United States)
Univ. of New Mexico (United States)
V. Murray, VisionQuest Biomedical, LLC (United States)
S. Barriga, VisionQuest Biomedical, LLC (United States)
P. Soliz, VisionQuest Biomedical, LLC (United States)

Published in SPIE Proceedings Vol. 8670:
Medical Imaging 2013: Computer-Aided Diagnosis
Carol L. Novak; Stephen Aylward, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?