Share Email Print

Proceedings Paper

Augmented reality with Microsoft HoloLens holograms for near infrared fluorescence based image guided surgery
Author(s): Nan Cui; Pradosh Kharel; Viktor Gruev
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Near infrared fluorescence (NIRF) based image guided surgery aims to provide vital information to the surgeon in the operating room, such as locations of cancerous tissue that should be resected and healthy tissue that should to be preserved. Targeted molecular markers, such as tumor or nerve specific probes, are used in conjunctions with NIRF imaging and display systems to provide key information to the operator in real-time. One of the major hurdles for the wide adaptation of these imaging systems is the high cost to operate the instruments, large footprint and complexity of operating the systems. The emergence of wearable NIRF systems has addressed these shortcomings by minimizing the imaging and display systems’ footprint and reducing the operational cost. However, one of the major shortcomings for this technology is the replacement of the surgeon’s natural vision with an augmented reality view of the operating room. In this paper, we have addressed this major shortcoming by exploiting hologram technology from Microsoft HoloLens to present NIR information on a color image captured by the surgeon’s natural vision. NIR information is captured with a CMOS sensor with high quantum efficiency in the 800 nm wavelength together with a laser light illumination light source. The NIR image is converted to a hologram that is displayed on Microsoft HoloLens and is correctly co-registered with the operator’s natural eyesight.

Paper Details

Date Published: 8 February 2017
PDF: 6 pages
Proc. SPIE 10049, Molecular-Guided Surgery: Molecules, Devices, and Applications III, 100490I (8 February 2017); doi: 10.1117/12.2251625
Show Author Affiliations
Nan Cui, Washington Univ. in St. Louis (United States)
Pradosh Kharel, Washington Univ. in St. Louis (United States)
Viktor Gruev, Univ. of Illinois at Urbana-Champaign (United States)

Published in SPIE Proceedings Vol. 10049:
Molecular-Guided Surgery: Molecules, Devices, and Applications III
Brian W. Pogue; Sylvain Gioux, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?