Share Email Print

Proceedings Paper • new

On the use of artificial intelligence for solving inverse problems (Conference Presentation)
Author(s): George Barbastathis; Alexandre Goy; Shuai Li; Mo Deng; Kwabena Arthur; Zhengyun Zhang
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

I will discuss the emerging trend in computational imaging to train deep neural networks (DNNs) for image formation. The DNNs are trained from examples consisting of pairs of known objects and their corresponding raw images drawn from databases such as ImageNet, Faces-LFW and MNIST. The raw images are converted to complex amplitude maps and displayed on a Spatial Light Modulator (SLM.) After training, the DNNs are capable of recovering unknown objects, i.e. objects not previously included in the training sets, from the raw images in several scenarios: (1) phase objects retrieved from intensity after lensless propagation; (2) phase objects retrieved from intensity after lensless propagation at extremely low photon counts; and (3) amplitude objects retrieved from intensity in-focus after propagation through a strong scatterer. Recovery is robust to disturbances in the optical system, such as additional defocus or various misalignments. This suggests that DNNs may form robust internal models of the physics of light propagation and detection and generalize priors from the training set. In the talk I will discuss in more detail various methods to incorporate the physics into DNN training, and how DNN architecture and “hyper-parameters” (i.e., depth, number of units in each depth, presence or absence of skip connections, etc.) influence the quality of image recovery.

Paper Details

Date Published: 13 March 2019
Proc. SPIE 10887, Quantitative Phase Imaging V, 108870W (13 March 2019); doi: 10.1117/12.2513283
Show Author Affiliations
George Barbastathis, Massachusetts Institute of Technology (United States)
Singapore-MIT Alliance for Research and Technology (Singapore)
Alexandre Goy, Massachusetts Institute of Technology (United States)
Shuai Li, Massachusetts Institute of Technology (United States)
Mo Deng, Massachusetts Institute of Technology (United States)
Kwabena Arthur, Massachusetts Institute of Technology (United States)
Zhengyun Zhang, SMART-Singapore MIT Alliance for Research & Technology (Singapore)

Published in SPIE Proceedings Vol. 10887:
Quantitative Phase Imaging V
Gabriel Popescu; YongKeun Park, Editor(s)

© SPIE. Terms of Use
Back to Top