Vision-Correcting Displays

Display technology automatically corrects for visions defects

01 October 2014

Researchers at Massachusetts Institute of Technology (MIT) and University of California, Berkeley in the US have developed a new display technology that automatically corrects for vision defects — no glasses (or contact lenses) required.

The technique could lead to dashboard-mounted GPS displays that farsighted drivers can consult without putting on their glasses or electronic readers that eliminate the need for reading glasses.

The display is a variation on a glasses-free 3D technology developed at MIT. But where the 3D display projects slightly different images to the viewer’s left and right eyes, the vision-correcting display projects slightly different images to different parts of the viewer’s pupil.

Rather than correcting vision defects with lenses and/or invasive surgery, “We have a different solution that basically puts the glasses on the display rather than on your head,” says Gordon Wetzstein, an MIT Media Lab research scientist and one of the displays’ co-creators. “It will not be able to help you see the rest of the world more sharply, but today we spend a huge portion of our time interacting with the digital world.”

Wetzstein’s research colleagues are Ramesh Raskar, the NEC Career Development Professor of Media Arts and Sciences and director of the MIT Media Lab’s Camera Culture group, and Berkeley’s Fu-Chung Huang and Brian Barsky. Wetzstein, Raskar, and Barsky have authored or co-authored papers on imaging systems and displays at recent SPIE conferences, including at IS&T/SPIE Electronic Imaging and SPIE Photonics West.


A vision defect is a mismatch between the eye’s focal distance — the range at which it can actually bring objects into focus — and the distance of the object on which it’s trying to focus. Essentially, the new display simulates an image at the correct focal distance, somewhere between the display and the viewer’s eye.

The difficulty with this approach is that simulating a single pixel in the virtual image requires multiple pixels of the physical display. The angle at which light should seem to arrive from the simulated image is sharper than the angle at which light would arrive from the same image displayed on the screen. So the physical pixels projecting light to the right side of the pupil have to be offset to the left, and the pixels projecting light to the left side of the pupil have to be offset to the right.

The use of multiple on-screen pixels to simulate a single virtual pixel would drastically reduce the image resolution. But this problem turns out to be very similar to a problem solved by 3D displays, which also had to project different images at different angles.

The researchers discovered that there is, in fact, a great deal of redundancy between the images required to simulate different viewing angles. The algorithm that computes the image to be displayed onscreen can exploit that redundancy, allowing individual screen pixels to participate simultaneously in the projection of different viewing angles. The MIT and Berkeley researchers were able to adapt that algorithm to the problem of vision correction, so the new display incurs only a modest loss in resolution.

In the researchers’ prototype, however, display pixels do have to be masked from the parts of the pupil for which they’re not intended. That requires that a transparency patterned with an array of pinholes be laid over the screen, blocking more than half the light it emits.

Early versions of the 3D display faced the same problem, and the MIT researchers solved it by instead using two LCDs in parallel. Carefully tailoring the images displayed on the LCDs to each other allows the system to mask perspectives while letting much more light pass through.

Wetzstein envisions that commercial versions of a vision-correcting screen would use the same technique.

Indeed, he says, the same screens could both display 3D content and correct for vision defects, all glasses-free. They could also reproduce another MIT Camera Culture project, which diagnoses vision defects. So the same device could, in effect, determine the user’s prescription and automatically correct for it.

image for Vision-Correcting Displays article
Vision correction with computational displays. On a conventional screen, people with optical aberrations see a blurred image. Current approaches to aberration-correcting displays use multilayer prefiltering or light field displays. Proposed display is at bottom right.
Courtesy: MIT Media Lab, Camera Culture Group

“Most people in mainstream optics would have said, ‘Oh, this is impossible,’” says SPIE Fellow Chris Dainty, a professor at University College London Institute of Ophthalmology and Moorfields Eye Hospital. “But Ramesh’s group has the art of making the apparently impossible possible.

“The key thing is they seem to have cracked the contrast problem,” Dainty adds. “In image-processing schemes with incoherent light — normal light that we have around us, nonlaser light — you’re always dealing with intensities. And intensity is always positive (or zero). Because of that, you’re always adding positive things, so the background just gets bigger and bigger and bigger. And the signal-to-background, which is contrast, therefore gets smaller as you do more processing. It’s a fundamental problem.”

Dainty believes that the most intriguing application of the technology is in dashboard displays.

“Most people over 50, 55, quite probably see in the distance fine, but can’t read a book,” Dainty says. “In the car, you can wear varifocals, but varifocals distort the geometry of the outside world, so if you don’t wear them all the time, you have a bit of a problem. There, [the MIT and Berkeley researchers] have a great solution.”


logo for Photonics for a Better WorldSPIE Professional launched its “Photonics for a Better World” series in the SPIE member magazine five years ago to show the optical and photonics technologies - and the people who work with them - that have brought tangible social, environmental, health, and economic gains to humanity.

For instance, photonics technologies bring inexpensive, sustainable, and efficient alternative energy to rural and developing areas without access to electricity and help people to see, hear, and communicate.

Laser technologies make the world better by killing malaria-carrying mosquitoes, allowing surgeons to operate on tissue one cell at a time, and by telling farmers the best time to irrigate their fields.

Other optical and photonics technologies have lead to the growth of the entertainment industry and instant communications at home and in space. Food inspections, medical imaging, and personal and community security also rely on photonics technologies.

Read more articles and blog posts celebrating the many ways that optics and photonics are applied in creating a better world:

Recent News
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?