Share Email Print

Proceedings Paper • new

Learning imbalanced semantic segmentation through cross-domain relations of multi-agent generative adversarial networks
Author(s): Mina Rezaei; Haojin Yang; Christoph Meinel
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Inspired by the recent success of generative adversarial networks (GANs), we propose a multi-agent GANs, named 3DJoinGANs, for handling imbalanced training data for the task of semantic segmentation. Our proposed method comprises two conditional GANs with four agents: a couple segmentors and a couple discriminators. The proposed framework learns a joint distribution of magnetic resonance images (MRI) and computed tomography images (CT) from different brain diseases by enforcing a weight-sharing constraint. While the first segmentor is trained on 3D multi-model MRI to learn semantic segmentation of a brain tumor(s), the first discriminator classifies whether predicted output by segmentor is real or fake. On the other hand, the second segmentor takes 3D multi modal CT images to learn segmentation of brain stroke lesions, and the second discriminator classifies between a segmented output by segmentor and a ground truth data annotated by an expert. We investigate, the 3DJoinGANs is able to mitigate imbalanced data problems and improve segmentation results due to oversampling and training through a joint distribution of cross-domain images.The proposed architecture has shown promising performance on the ISLES-2018 benchmark for segmentation of 3D multi modal ischemic stroke lesions and semantic segmentation of 3D multi modal brain tumors from the BraTS-2018 challenge.

Paper Details

Date Published: 13 March 2019
PDF: 8 pages
Proc. SPIE 10950, Medical Imaging 2019: Computer-Aided Diagnosis, 1095027 (13 March 2019); doi: 10.1117/12.2512215
Show Author Affiliations
Mina Rezaei, Hasso Plattner Institute (Germany)
Haojin Yang, Hasso Plattner Institute (Germany)
Christoph Meinel, Hasso Plattner Institute (Germany)

Published in SPIE Proceedings Vol. 10950:
Medical Imaging 2019: Computer-Aided Diagnosis
Kensaku Mori; Horst K. Hahn, Editor(s)

© SPIE. Terms of Use
Back to Top