Share Email Print

Journal of Medical Imaging • new

On-the-fly augmented reality for orthopedic surgery using a multimodal fiducial
Author(s): Sebastian Andress; Alex Johnson; Mathias Unberath; Alexander F. Winkler; Kevin Yu; Javad Fotouhi; Simon Weidert; Greg M. Osgood; Nassir Navab
Format Member Price Non-Member Price
PDF $20.00 $25.00

Paper Abstract

Fluoroscopic x-ray guidance is a cornerstone for percutaneous orthopedic surgical procedures. However, two-dimensional (2-D) observations of the three-dimensional (3-D) anatomy suffer from the effects of projective simplification. Consequently, many x-ray images from various orientations need to be acquired for the surgeon to accurately assess the spatial relations between the patient’s anatomy and the surgical tools. We present an on-the-fly surgical support system that provides guidance using augmented reality and can be used in quasiunprepared operating rooms. The proposed system builds upon a multimodality marker and simultaneous localization and mapping technique to cocalibrate an optical see-through head mounted display to a C-arm fluoroscopy system. Then, annotations on the 2-D x-ray images can be rendered as virtual objects in 3-D providing surgical guidance. We quantitatively evaluate the components of the proposed system and, finally, design a feasibility study on a semianthropomorphic phantom. The accuracy of our system was comparable to the traditional image-guided technique while substantially reducing the number of acquired x-ray images as well as procedure time. Our promising results encourage further research on the interaction between virtual and real objects that we believe will directly benefit the proposed method. Further, we would like to explore the capabilities of our on-the-fly augmented reality support system in a larger study directed toward common orthopedic interventions.

Paper Details

Date Published: 26 January 2018
PDF: 12 pages
J. Med. Imag. 5(2) 021209 doi: 10.1117/1.JMI.5.2.021209
Published in: Journal of Medical Imaging Volume 5, Issue 2
Show Author Affiliations
Sebastian Andress, Johns Hopkins Univ. (United States)
Ludwig-Maximilians-Univ. München (Germany)
Alex Johnson, The Johns Hopkins Hospital (United States)
Mathias Unberath, Johns Hopkins Univ. (United States)
Alexander F. Winkler, Johns Hopkins Univ. (United States)
Technische Univ. München (Germany)
Kevin Yu, Johns Hopkins Univ. (United States)
Technische Univ. München (Germany)
Javad Fotouhi, Johns Hopkins Univ. (United States)
Simon Weidert, Ludwig-Maximilians-Univ. München (Germany)
Greg M. Osgood, The Johns Hopkins Hospital (United States)
Nassir Navab, Johns Hopkins Univ. (United States)
Technische Univ. München (Germany)

© SPIE. Terms of Use
Back to Top