Share Email Print

Proceedings Paper

Multi-modal deep learning for predicting progression of Alzheimer's disease using bi-linear shake fusion
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Alzheimer’s Disease (AD) which causes declination of cognitive function is one of the most severe social issues in the world. It has already been known that AD cannot be cured and treatment can only delay its progression. Therefore, it is very important to detect AD in early stage and prevent it to be worse. Furthermore, sooner the progression is detected, better the prognosis will be. In this research, we developed a novel multi-modal deep learning method to predict conversion from Mild Cognitive Impairment (MCI), which is the stage between cognitively normal older people and AD. In our method, the multi-modal input data are defined as structural Magnetic Resonance Imaging (MRI) images and clinical data including several cognitive scores, APOE genotype, gender and age obtained from Alzheimer’s Disease Neuroimaging Initiative cohort (ADNI). Our criteria of selecting these input data are that they are mostly obtained by non-invasive examination. The proposed method integrates features obtained from MRI images and clinical data effectively by using bi-linear fusion. Bi-linear fusion computes the products of all elements between image and clinical features, where the correlation between them are included. That led to a big improvement of prediction accuracy in the experiment. The prediction model using bi-linear fusion achieved to predict conversion in one year with 0.86 accuracy, comparing with 0.76 accuracy using linear fusion. The proposed method is useful for screening examination for AD or deciding a stratification approach within clinical trials since it achieved a high accuracy while the input data is relatively easy to be obtained.

Paper Details

Date Published: 16 March 2020
PDF: 6 pages
Proc. SPIE 11314, Medical Imaging 2020: Computer-Aided Diagnosis, 113141X (16 March 2020); doi: 10.1117/12.2549483
Show Author Affiliations
Tsubasa Goto, FUJIFILM Corp. (Japan)
Caihua Wang, FUJIFILM Corp. (Japan)
Yuanzhong Li, FUJIFILM Corp. (Japan)
Yukihiro Tsuboshita, Fuji Xerox Co., Ltd. (Japan)

Published in SPIE Proceedings Vol. 11314:
Medical Imaging 2020: Computer-Aided Diagnosis
Horst K. Hahn; Maciej A. Mazurowski, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?