 Astronomy
 Biomedical Optics & Medical Imaging
 Defense & Security
 Electronic Imaging & Signal Processing
 Illumination & Displays
 Lasers & Sources
 Micro/Nano Lithography
 Nanotechnology
 Optical Design & Engineering
 Optoelectronics & Communications
 Remote Sensing
 Sensing & Measurement
 Solar & Alternative Energy
 Sign up for Newsroom EAlerts
 Information for:
Advertisers




Biomedical Optics & Medical Imaging
Rapid, highresolution phase images for live cell imaging
Laura Waller and Lei Tian
Using multiplexing and an LED array to code illumination angles in a commercial microscope achieves fast capture times, resolution beyond the diffraction limit, and a very large field of view.
17 November 2014, SPIE Newsroom. DOI: 10.1117/2.1201411.005675
The LED array microscope is a powerful new tool that uses computational illumination to turn lowpower microscopes into highresolution imagers. The hardware involves a simple replacement of the light source with a programmable LED array^{1, 2} (see Figure 1). Since the LED array is at the Fourier plane of the sample, each LED corresponds to a unique illumination angle, allowing arbitrary patterning of angles. Conveniently, the range of illumination angles can be much larger than that allowed by the microscope's numerical aperture (NA). Thus, by choosing which LEDs to illuminate, we can achieve brightfield and darkfield imaging modes^{1, 3} or phase contrast.^{3–5} Figure 1 shows a single frame of a 50Hz video in which we timemultiplex all three contrast modes for simultaneous capture.^{3}
Figure 1. Computational illumination in a commercial microscope. An LED array replaces the illumination unit for flexible patterning of illumination angles at the sample. One use of this setup is shown below, demonstrating simultaneous brightfield, darkfield, and phase contrast imaging at 50Hz. T: Top. B: Bottom.
The LED array microscope can also be used for 3D intensity^{1} or phase contrast^{4} imaging. To achieve this, one must scan through each illumination angle in the 2D array while capturing an image for each. The resulting 4D data set can be thought of as a light field^{6} or phasespace measurement,^{7} and thus can be used for digital refocusing, aberration removal, or 3D recovery. Alternatively, this same 4D data set, when used with a thin sample, can provide synthetically enhanced resolution, since the darkfield images contain information about subresolution features in the sample.^{2, 8}
The process of using the LED array microscope to achieve resolution beyond the diffraction limit of the objective NA is called Fourier ptychography. One can use a low NA objective, having a very large field of view (FoV), but still obtain high resolution across the entire image, resulting in gigapixel images. The aberrations in the imaging system can also be estimated and corrected.^{9} For thin samples, illuminating from different angles corresponds to a shift in Fourier space, such that different spatial frequencies pass through the pupil for each LED. The goal of the inverse algorithm is to stitch together the images from different areas of Fourier space to achieve a synthetic NA that is the sum of the objective NA and illumination NA. The caveat of using Fourier space stitching is that phase information is required, which must be inferred by an optimization process based on angular diversity, analogous to ptychography based on spatial translation.^{10–13} For such algorithms to converge, significant (>60%) overlap is required between the Fourier space areas of neighboring LEDs,^{2, 14} so they must be closely packed. The main limitations of Fourier ptychography are the large amount of data captured and the long acquisition times required for sequential scanning of each LED.
We recently showed that multiplexing is capable of reducing both acquisition time and the number of images required by orders of magnitude.^{8} We illuminate the sample from multiple angles simultaneously in each measurement, corresponding to multiple coherent modes. Turning on multiple LEDs increases the amount of power reaching the camera and decreases the required exposure time proportionately. To reduce acquisition time further, we can also reduce the number of total images captured, since each image contains information from multiple spatial frequency bands. Reducing the captured data too far will result in the reconstruction algorithm failing to converge (consider the limiting case of turning all LEDs on, in which case no phase information can be reconstructed). We have demonstrated up to eight LEDs multiplexed at once (see Figure 2). Being a nonlinear optimization procedure, convergence failures of the algorithm are difficult to predict theoretically, and we provide here only empirical evidence that this strategy can be used to reduce data acquisition significantly.
Figure 2. Experimental results for Fourier ptychography with multiplexed illumination. The full fieldofview image and a lowresolution zoomin of one sample area (top). Highresolution reconstruction result (bottom) comparing single LED sequential scan with multiplexed capture under two different schemes. The first captures the same number of images as the sequential scan, but uses a shorter exposure time due to higher throughput from more LEDs being on. The second reduces both the exposure time and the number of images captured, since each image covers multiple areas of Fourier space via multiplexing. Multiplexed illumination significantly reduces capture times without sacrificing reconstruction quality. T: Time.
By speeding up the capture of data in Fourier ptychography with an LED array microscope, we are moving toward realtime gigapixel intensity and phase imaging. Future work will explore optimal coding strategies and improved hardware for subsecond data capture. This opens up new application areas in live cell imaging and dynamic microscopy.
Laura Waller, Lei Tian
Department of Electrical Engineering and Computer Sciences
University of California, Berkeley
Berkeley, CA
Laura Waller is an assistant professor. She received BS, MEng, and PhD degrees in electrical engineering and computer sciences from the Massachusetts Institute of Technology in 2004, 2005, and 2010, respectively. She is a Moore Foundation datadriven investigator, Bakar Fellow, a National Science Foundation CAREER awardee, and Packard Fellow. She is a member of SPIE.
References:
1. G. Zheng, C. Guoan, C. Yang, Microscopy refocusing and darkfield imaging by using a simple LED array, Opt. Lett. 36(20), p. 39873989, 2011.
2. G. Zheng, R. Horstmeyer, C. Yang, Widefield, highresolution Fourier ptychographic microscopy, Nat. Photon. 7(9), p. 739745, 2013. doi:10.1038/nphoton.2013.187
3. Z. Liu, L. Tian, S. Liu, L. Waller, Realtime brightfield, darkfield, and phase contrast imaging in a lightemitting diode array microscope, J. Biomed. Opt. 19, p. 106002, 2014. doi: 10.1117/1.JBO.19.10.106002
4. L. Tian, J. Wang, L. Waller, 3D differential phasecontrast microscopy with computational illumination using an LED array, Opt. Lett. 39(5), p. 13261329, 2014. doi:10.1364/OL.39.001326
7. L. Waller, G. Situ, J. W. Fleischer, Phasespace measurement and coherence synthesis of optical beams, Nat. Photon. 6, p. 474479, 2012.
8. L. Tian, X. Li, K. Ramchandran, L. Waller, Multiplexed coded illumination for Fourier ptychography with an LED array microscope, Biomed. Opt. Express 5(7), p. 23762389, 2014.
9. X. Ou, G. Zheng, C. Yang, Embedded pupil function recovery for Fourier ptychographic microscopy, Opt. Express 22(5), p. 49604972, 2014. doi:10.1364/OE.22.004960
10. J. M. Rodenburg, H. M. L. Faulkner, A phase retrieval algorithm for shifting illumination, Appl. Phys. Lett. 85(20), p. 47954797, 2004.
11. M. GuizarSicairos, J. M. Fienup, Phase retrieval with transverse translation diversity: a nonlinear optimization approach, Opt. Express 16(10), p. 72647278, 2008.
12. A. M. Maiden, J. M. Rodenburg, An improved ptychographical phase retrieval algorithm for diffractive imaging, Ultramicroscopy 109(10), p. 12561262, 2009.
13. P. Thibault, M. Dierolf, O. Bunk, A. Menzel, F. Pfeiffer, Probe retrieval in ptychographic coherent diffractive imaging, Ultramicroscopy 109(4), p. 338343, 2009.
14. O. Bunk, M. Dierolf, S. Kynde, I. Johnson, O. Marti, F. Pfeiffer, Influence of the overlap parameter on the convergence of the ptychographical iterative engine, Ultramicroscopy 108(5), p. 481487, 2008.


