Share Email Print

Proceedings Paper

Deep similarity learning using a Siamese ResNet trained on similarity labels from disparity maps of cerebral MRA MIP pairs
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Similarity measures are a critical component for iterative registration tasks. In intrinsic 2D/3D registration an initialization close to the solution is usually needed for convergence. Traditional similarity measures are limited in their applicability to perspective projection data. Deep Learning allows us to create similarity measures that encode almost arbitrary non-linear relationships like perspective projection. We apply a siamese network and a 2-channel network to the problem of comparing two perspective maximum intensity projections of medical data. We propose the use of residual units as the building block. A major challenge is to define similarity under perspective projection so that it can be used for training. Extrinsic registration gives us a gold standard of registered examples but we need a way to quantify the dissimilarity of unregistered image pairs for training. We propose the use of disparity as the basis for construction of similarity labels, i.e. labels are based on distances between projected points when viewing the same 3D point through different cameras. The final similarity labels are independent of the choice of camera parametrization and describe the visual similarity of two given views of a common 3D model. We compare our deep similarity metric to traditional similarity measures for a comparative evaluation. Our best configuration has a Pearson correlation coefficient of 0.792 and a Spearman’s rank correlation coefficient of 0.480. The best traditional method is normalized cross correlation with a 5.4% lower Spearman’s rank correlation coefficient.

Paper Details

Date Published: 10 March 2020
PDF: 10 pages
Proc. SPIE 11313, Medical Imaging 2020: Image Processing, 113132N (10 March 2020); doi: 10.1117/12.2548576
Show Author Affiliations
Christian Neumann, Hochschule Niederrhein (Germany)
Klaus D. Tönnies, Univ. of Magdeburg (Germany)
Regina Pohle-Fröhlich, Hochschule Niederrhein (Germany)

Published in SPIE Proceedings Vol. 11313:
Medical Imaging 2020: Image Processing
Ivana Išgum; Bennett A. Landman, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?