Share Email Print

Proceedings Paper

Weakly non-rigid MR-TRUS prostate registration using fully convolutional and recurrent neural networks
Author(s): Qiulan Zeng; Yabo Fu; Jiwoong Jeong; Yang Lei; Tonghe Wang; Hui Mao; Ashesh B. Jani; Pretesh Patel; Walter J. Curran; Tian Liu; Xiaofeng Yang
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In this study, we propose a new deep learning (DL) framework, a combination of fully convolutional and recurrent neural networks, and integrate them with a weakly supervised method for 3D MRI-transrectal ultrasound (TRUS) image registration. The MR and TRUS images are often highly anisotropic in its dimensions. For instance, in 3D US images the scale of each voxel in depth is often 5~10 times larger than that in each image slice. This high anisotropy makes the common 3D isotropic kernel suffer poor generality, resulting in unsatisfactory registration results in terms of accuracy. The key idea of the paper is to explicitly leverage 3D image anisotropy through the exploitation of the intra-slice context with a fully convolutional network (FCN) and the utilization of the inter-slice context with a recurrent neural network (RNN). After the 3D hierarchical features in MRI and TRUS have been extracted, we generate the dense deformation field by aligning corresponding prostate labels for individual image pairs. Experimental results showed that our proposed FCN-RNN neural network produces a mean target registration error (TRE) of 2.77±1.40 mm, and a mean dice similarity coefficient (DSC) of 0.9.

Paper Details

Date Published: 10 March 2020
PDF: 7 pages
Proc. SPIE 11313, Medical Imaging 2020: Image Processing, 113132Y (10 March 2020); doi: 10.1117/12.2549771
Show Author Affiliations
Qiulan Zeng, Emory Univ. (United States)
Yabo Fu, Emory Univ. (United States)
Jiwoong Jeong, Emory Univ. (United States)
Yang Lei, Emory Univ. (United States)
Tonghe Wang, Emory Univ. (United States)
Hui Mao, Emory Univ. (United States)
Ashesh B. Jani, Emory Univ. (United States)
Pretesh Patel, Emory Univ. (United States)
Walter J. Curran, Emory Univ. (United States)
Tian Liu, Emory Univ. (United States)
Xiaofeng Yang, Emory Univ. (United States)

Published in SPIE Proceedings Vol. 11313:
Medical Imaging 2020: Image Processing
Ivana Išgum; Bennett A. Landman, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?