Teledermatologic views at 16-bit color depth yield accurate diagnoses
The Veterans Affairs (VA) Veterans Integrated Service Network 20 (VISN 20) is a group of healthcare facilities serving 135 counties in the Pacific Northwest and Alaska, an area that encompasses nearly one-quarter of the landmass of the United States.1 Its mission is to provide top-quality care to America's veterans. Given the physical expanse of the area served, however, geographic constraints can impose challenging difficulties for rural veterans seeking consultations and diagnoses. The VISN 20 teledermatology project2 using remote imaging for diagnostic purposes was implemented in 2009 to help address this issue by providing co-managed dermatology care for these veterans.
Multiple studies have compared the diagnostic accuracy of face-to-face imaging with remote imaging—teledermatology—and a majority of these report slightly better accuracy with the former. However, the American Telemedicine Association has determined that 24-bit images3 are suitable for remote diagnoses, and comparisons of face-to-face with remote approaches yielded very similar management concordance and outcomes. Further, patient satisfaction is consistently high with teledermatology.4, 5
Digital-image quality is dependent on multiple factors: the capture device used, image size, compression algorithm (i.e., JPEG, BMP, TIFF, RAW), monitor size and resolution, and color depth. In our study, in which we used similar capture devices, image sizes, and monitors, color depth measured in bits per pixel, or ‘bit,’ was the principal variable. Although in-hospital views on the VA Computerized Patient Record System are shown as 32-bit images, the Internet-based system views on the Citrix Access Gateway, a remote-access device used to produce images from off-site locations, displays 16-bit images.
We undertook a quality assurance review comparing diagnostic accuracy between 16-bit and 32-bit color (i.e., remote and local access) of a VISN 20 rural teledermatology project. Beginning in 2009, two of us, along with six board-certified dermatologists serving as consultants, chose a retrospective cohort of 618 patients from VISN 20 to evaluate for 18 months. The VA predominantly serves an older, Caucasian male population, both nationally and in VISN 20,6, 7 but because this was a quality improvement/quality assurance project, we did not collect detailed demographic data. We required all patients to have their lesions biopsied as recommended during our consultations, and we subsequently confirmed the diagnoses—821 lesions—with histopathology, the diagnostic gold standard. We required an exact diagnosis within a narrow range. For example, we considered a hypertrophic actinic keratosis equal to actinic keratosis. Conversely, however, we did not regard severely atypical nevus or hypertrophic actinic keratosis as equal, respectively, to melanoma in situ or squamous cell carcinoma in situ.
One physician performed consultations using both 16- and 32-bit imaging, and four used 16-bit imaging, allowing comparisons both within an individual physician's findings and between other physicians' findings. We performed all analyses at the level of the biopsy (n=821). As we correlated measures from biopsies within patient and within physician, we compared diagnostic accuracy between the 16- and 32-bit groups using a mixed-effects logistic regression model with one fixed effect (image group), a random intercept effect for the physician reader, and a random intercept effect for the patient. We adjusted for the physician reader because we did not randomize image groups, and allowing for any factors related to group assignment is necessary for causal inference on outcomes between image groups.
We determined the diagnostic accuracy as follows: 350 (43%) biopsies were performed in conjunction with 16-bit imaging and 471 (57%) with 32-bit imaging (see Table 1). Diagnostic accuracy was slightly higher for 32-bit versus 16-bit (77% versus 74%) imaging, and results from the mixed-effects logistic regression model estimated the odds ratio of a correct diagnosis with the 32-bit image as 1.21, with p-value=0.25; 95% confidence interval=0.88–1.67. These results are not statistically significant. The most common diagnosis was basal cell carcinoma at 189 (24%), followed by seborrheic keratosis at 104 (13%), and squamous cell carcinoma at 63 (8%). There were 18 malignant melanomas (2%) and 7 melanomas in situ (1%) identified (see Table 2).
|Basal cell carcinoma||189||24%|
|Squamous cell carcinoma||63||8%|
|Squamous cell carcinoma in situ||35||4%|
|Benign lichenoid keratosis||13||2%|
|Melanoma in situ||7||1%|
The difference between 16- and 32-bit imaging is visible only at very high magnification or when using a gradient of a single color (see Figure 1), which leads to obvious color banding on the 16-bit image where the right side of the image shows sharp steps in the color gradient. It is difficult to distinguish between even very low- and very high-quality photos (see Figure 2) when comparing close-up views of 8-bit (256 colors) and 24-bit (16.7 million colors) images. When comparing 16- and 32-bit clinical images of a malignant melanoma from this study, we found them virtually indistinguishable (see Figure 3). On 400% magnification, there is subtle color banding and a granular quality on the 16-bit image, but we are confident that these would not impede the clinician's view. Thus our results, showing an overall diagnostic accuracy of 76%, which is on the high end compared with other published data,4 revealed no significant difference in diagnostic accuracy between 16- and 32-bit imaging and confirmed that using 16-bit imaging does not compromise quality of care.
An unavoidable weakness of this study lies in the homogeneity of the veteran population, which limits our ability to generalize the findings. In addition, the requirement for histopathologic correlation that we imposed may also slant the diagnoses toward suspected skin cancers.
To continue to refine teledermatologic imaging, we are expanding the scale of the project with quality assurance initiatives to ensure the highest level of care. All remote sites now have high-quality digital cameras, and we are focusing on continued training for those obtaining the images. Finally, although this project demonstrated equivalent diagnostic accuracy for varying-image color depth, all consults will likely be done with 32-bit images as the system is upgraded.