SPIE Startup Challenge 2015 Founding Partner - JENOPTIK Get updates from SPIE Newsroom
  • Newsroom Home
  • Astronomy
  • Biomedical Optics & Medical Imaging
  • Defense & Security
  • Electronic Imaging & Signal Processing
  • Illumination & Displays
  • Lasers & Sources
  • Micro/Nano Lithography
  • Nanotechnology
  • Optical Design & Engineering
  • Optoelectronics & Communications
  • Remote Sensing
  • Sensing & Measurement
  • Solar & Alternative Energy
  • Sign up for Newsroom E-Alerts
  • Information for:
    Advertisers
SPIE Defense + Commercial Sensing 2017 | Register Today

OPIE 2017

OPIC 2017

SPIE Journals OPEN ACCESS

SPIE PRESS

SPIE PRESS




Print PageEmail PageView PDF

Biomedical Optics & Medical Imaging

Rapid, high-resolution phase images for live cell imaging

Using multiplexing and an LED array to code illumination angles in a commercial microscope achieves fast capture times, resolution beyond the diffraction limit, and a very large field of view.

17 November 2014, SPIE Newsroom. DOI: 10.1117/2.1201411.005675

The LED array microscope is a powerful new tool that uses computational illumination to turn low-power microscopes into high-resolution imagers. The hardware involves a simple replacement of the light source with a programmable LED array1, 2 (see Figure 1). Since the LED array is at the Fourier plane of the sample, each LED corresponds to a unique illumination angle, allowing arbitrary patterning of angles. Conveniently, the range of illumination angles can be much larger than that allowed by the microscope's numerical aperture (NA). Thus, by choosing which LEDs to illuminate, we can achieve brightfield and darkfield imaging modes1, 3 or phase contrast.3–5 Figure 1 shows a single frame of a 50Hz video in which we time-multiplex all three contrast modes for simultaneous capture.3


Figure 1. Computational illumination in a commercial microscope. An LED array replaces the illumination unit for flexible patterning of illumination angles at the sample. One use of this setup is shown below, demonstrating simultaneous brightfield, darkfield, and phase contrast imaging at 50Hz. T: Top. B: Bottom.

The LED array microscope can also be used for 3D intensity1 or phase contrast4 imaging. To achieve this, one must scan through each illumination angle in the 2D array while capturing an image for each. The resulting 4D data set can be thought of as a light field6 or phase-space measurement,7 and thus can be used for digital refocusing, aberration removal, or 3D recovery. Alternatively, this same 4D data set, when used with a thin sample, can provide synthetically enhanced resolution, since the darkfield images contain information about subresolution features in the sample.2, 8

The process of using the LED array microscope to achieve resolution beyond the diffraction limit of the objective NA is called Fourier ptychography. One can use a low NA objective, having a very large field of view (FoV), but still obtain high resolution across the entire image, resulting in gigapixel images. The aberrations in the imaging system can also be estimated and corrected.9 For thin samples, illuminating from different angles corresponds to a shift in Fourier space, such that different spatial frequencies pass through the pupil for each LED. The goal of the inverse algorithm is to stitch together the images from different areas of Fourier space to achieve a synthetic NA that is the sum of the objective NA and illumination NA. The caveat of using Fourier space stitching is that phase information is required, which must be inferred by an optimization process based on angular diversity, analogous to ptychography based on spatial translation.10–13 For such algorithms to converge, significant (>60%) overlap is required between the Fourier space areas of neighboring LEDs,2, 14 so they must be closely packed. The main limitations of Fourier ptychography are the large amount of data captured and the long acquisition times required for sequential scanning of each LED.

We recently showed that multiplexing is capable of reducing both acquisition time and the number of images required by orders of magnitude.8 We illuminate the sample from multiple angles simultaneously in each measurement, corresponding to multiple coherent modes. Turning on multiple LEDs increases the amount of power reaching the camera and decreases the required exposure time proportionately. To reduce acquisition time further, we can also reduce the number of total images captured, since each image contains information from multiple spatial frequency bands. Reducing the captured data too far will result in the reconstruction algorithm failing to converge (consider the limiting case of turning all LEDs on, in which case no phase information can be reconstructed). We have demonstrated up to eight LEDs multiplexed at once (see Figure 2). Being a nonlinear optimization procedure, convergence failures of the algorithm are difficult to predict theoretically, and we provide here only empirical evidence that this strategy can be used to reduce data acquisition significantly.


Figure 2. Experimental results for Fourier ptychography with multiplexed illumination. The full field-of-view image and a low-resolution zoom-in of one sample area (top). High-resolution reconstruction result (bottom) comparing single LED sequential scan with multiplexed capture under two different schemes. The first captures the same number of images as the sequential scan, but uses a shorter exposure time due to higher throughput from more LEDs being on. The second reduces both the exposure time and the number of images captured, since each image covers multiple areas of Fourier space via multiplexing. Multiplexed illumination significantly reduces capture times without sacrificing reconstruction quality. T: Time.

By speeding up the capture of data in Fourier ptychography with an LED array microscope, we are moving toward real-time gigapixel intensity and phase imaging. Future work will explore optimal coding strategies and improved hardware for sub-second data capture. This opens up new application areas in live cell imaging and dynamic microscopy.


Laura Waller, Lei Tian
Department of Electrical Engineering and Computer Sciences
University of California, Berkeley
Berkeley, CA

Laura Waller is an assistant professor. She received BS, MEng, and PhD degrees in electrical engineering and computer sciences from the Massachusetts Institute of Technology in 2004, 2005, and 2010, respectively. She is a Moore Foundation data-driven investigator, Bakar Fellow, a National Science Foundation CAREER awardee, and Packard Fellow. She is a member of SPIE.


References:
1. G. Zheng, C. Guoan, C. Yang, Microscopy refocusing and dark-field imaging by using a simple LED array, Opt. Lett. 36(20), p. 3987-3989, 2011.
2. G. Zheng, R. Horstmeyer, C. Yang, Wide-field, high-resolution Fourier ptychographic microscopy, Nat. Photon. 7(9), p. 739-745, 2013. doi:10.1038/nphoton.2013.187
3. Z. Liu, L. Tian, S. Liu, L. Waller, Real-time brightfield, darkfield, and phase contrast imaging in a light-emitting diode array microscope, J. Biomed. Opt. 19, p. 106002, 2014. doi:10.1117/1.JBO.19.10.106002
4. L. Tian, J. Wang, L. Waller, 3D differential phase-contrast microscopy with computational illumination using an LED array, Opt. Lett. 39(5), p. 1326-1329, 2014. doi:10.1364/OL.39.001326
5. D. K. Hamilton, C. J. R. Sheppard, Differential phase contrast in scanning optical microscopy, J. Microsc. 133(1), p. 27-39, 1984. doi:10.1111/j.1365-2818.1984.tb00460.x/full
6. M. Levoy, Z. Zhang, I. McDowall, Recording and controlling the 4D light field in a microscope using microlens arrays, J. Microsc. 235(2), p. 144-162, 2009. doi:10.1111/j.1365-2818.2009.03195.x/full
7. L. Waller, G. Situ, J. W. Fleischer, Phase-space measurement and coherence synthesis of optical beams, Nat. Photon. 6, p. 474-479, 2012.
8. L. Tian, X. Li, K. Ramchandran, L. Waller, Multiplexed coded illumination for Fourier ptychography with an LED array microscope, Biomed. Opt. Express 5(7), p. 2376-2389, 2014.
9. X. Ou, G. Zheng, C. Yang, Embedded pupil function recovery for Fourier ptychographic microscopy, Opt. Express 22(5), p. 4960-4972, 2014. doi:10.1364/OE.22.004960
10. J. M. Rodenburg, H. M. L. Faulkner, A phase retrieval algorithm for shifting illumination, Appl. Phys. Lett. 85(20), p. 4795-4797, 2004.
11. M. Guizar-Sicairos, J. M. Fienup, Phase retrieval with transverse translation diversity: a nonlinear optimization approach, Opt. Express 16(10), p. 7264-7278, 2008.
12. A. M. Maiden, J. M. Rodenburg, An improved ptychographical phase retrieval algorithm for diffractive imaging, Ultramicroscopy 109(10), p. 1256-1262, 2009.
13. P. Thibault, M. Dierolf, O. Bunk, A. Menzel, F. Pfeiffer, Probe retrieval in ptychographic coherent diffractive imaging, Ultramicroscopy 109(4), p. 338-343, 2009.
14. O. Bunk, M. Dierolf, S. Kynde, I. Johnson, O. Marti, F. Pfeiffer, Influence of the overlap parameter on the convergence of the ptychographical iterative engine, Ultramicroscopy 108(5), p. 481-487, 2008.