Share Email Print

Proceedings Paper

Structure Sensor for mobile markerless augmented reality
Author(s): T. Kilgus; R. Bux; A. M. Franz; W. Johnen; E. Heim; M. Fangerau; M. Müller; K. Yen; L. Maier-Hein
Format Member Price Non-Member Price
PDF $17.00 $21.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

3D Visualization of anatomical data is an integral part of diagnostics and treatment in many medical disciplines, such as radiology, surgery and forensic medicine. To enable intuitive interaction with the data, we recently proposed a new concept for on-patient visualization of medical data which involves rendering of subsurface structures on a mobile display that can be moved along the human body. The data fusion is achieved with a range imaging device attached to the display. The range data is used to register static 3D medical imaging data with the patient body based on a surface matching algorithm. However, our previous prototype was based on the Microsoft Kinect camera and thus required a cable connection to acquire color and depth data. The contribution of this paper is two-fold. Firstly, we replace the Kinect with the Structure Sensor - a novel cable-free range imaging device - to improve handling and user experience and show that the resulting accuracy (target registration error: 4.8±1.5 mm) is comparable to that achieved with the Kinect. Secondly, a new approach to visualizing complex 3D anatomy based on this device, as well as 3D printed models of anatomical surfaces, is presented. We demonstrate that our concept can be applied to in vivo data and to a 3D printed skull of a forensic case. Our new device is the next step towards clinical integration and shows that the concept cannot only be applied during autopsy but also for presentation of forensic data to laypeople in court or medical education.

Paper Details

Date Published: 18 March 2016
PDF: 7 pages
Proc. SPIE 9786, Medical Imaging 2016: Image-Guided Procedures, Robotic Interventions, and Modeling, 97861L (18 March 2016); doi: 10.1117/12.2216057
Show Author Affiliations
T. Kilgus, German Cancer Research Ctr. (Germany)
R. Bux, Institute for Forensic Medicine and Traffic Medicine (Germany)
A. M. Franz, German Cancer Research Ctr. (Germany)
W. Johnen, German Cancer Research Ctr. (Germany)
E. Heim, German Cancer Research Ctr. (Germany)
M. Fangerau, German Cancer Research Ctr. (Germany)
M. Müller, German Cancer Research Ctr. (Germany)
K. Yen, Institute for Forensic Medicine and Traffic Medicine (Germany)
L. Maier-Hein, German Cancer Research Ctr. (Germany)

Published in SPIE Proceedings Vol. 9786:
Medical Imaging 2016: Image-Guided Procedures, Robotic Interventions, and Modeling
Robert J. Webster III; Ziv R. Yaniv, Editor(s)

© SPIE. Terms of Use
Back to Top