Procedural generation of synthetic multiplex immunohistochemistry images using cell-based image compression and conditional generative adversarial networks

Laurin Herbsthofer; Barbara Ehall; Martina Tomberger; Barbara Prietl; Thomas R. Pieber; Pablo López-García

doi:10.1117/12.2606365

4 April 2022 Procedural generation of synthetic multiplex immunohistochemistry images using cell-based image compression and conditional generative adversarial networks

Laurin Herbsthofer, Barbara Ehall, Martina Tomberger, Barbara Prietl, Thomas R. Pieber, Pablo López-García

Author Affiliations +

Proceedings Volume 12039, Medical Imaging 2022: Digital and Computational Pathology; 120390N (2022) https://doi.org/10.1117/12.2606365
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Abstract

Collecting substantial amounts of tissue image data is expensive, time consuming and often restricted by sample availability. This data sparsity limits the use of neural networks for image classification and knowledge extraction for many medical and biological applications. In this work, we present a novel method to procedurally generate synthetic fluorescent multiplex immunohistochemistry (fm-IHC) images using human-defined rules and a conditional Generative Adversarial Network (cGAN). Our method consists of three steps: First, we compress high-resolution fm-IHC images using a cell-based compression method (Cell2Grid) in which every cell is represented by just one pixel. We subsequently train a cGAN to reverse this compression. In a second step, we define a procedural algorithm for the generation of synthetic Cell2Grid images. We therefore (1) define rules for the generation of large-scale tissue morphology, (2) define the relative abundance of cell phenotypes in each tissue segment, and (3) define marker distributions for each phenotype. In a third step, we apply the trained cGAN to convert synthetic Cell2Grid images into fm-IHC images. As a showcase, we generated synthetic fm-IHC images of murine pancreatic islets in different stages of insulitis consisting of seven antibody color channels. We derived rules for the procedural algorithm using only 59 real sample images and trained the cGAN on 1,575 unlabeled fm-IHC image crops. We show that our method provides full control over tissue morphology, cell composition, and image ground truth and can support the training of image classification networks.

Conference Presentation

Citation Download Citation

Laurin Herbsthofer, Barbara Ehall, Martina Tomberger, Barbara Prietl, Thomas R. Pieber, and Pablo López-García "Procedural generation of synthetic multiplex immunohistochemistry images using cell-based image compression and conditional generative adversarial networks", Proc. SPIE 12039, Medical Imaging 2022: Digital and Computational Pathology, 120390N (4 April 2022); https://doi.org/10.1117/12.2606365

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available