Share Email Print

Proceedings Paper

Virtual scalpel simulation in the VR and AR environments
Author(s): Larisa A. Zherdeva; Konstantin V. Cherepanov; Denis A. Zherdev
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Currently, in virtual reality simulations and laboratories much attention is focused on the development of a user interaction controller for better immersion and student experience. Of course, the visual experience is a base for the laboratory study of any students, but direct contact with the visualized environment is also important. This paper presents a virtual scalpel technique that simulates the experience of medical discipline student education using virtual reality (VR) and augmented reality (AR) laboratory software. User's hands and a pencil with a tracker marker are the main tracking system components. Due to the high sensitivity of hand sign recognition, the Leap Motion camera was chosen as the base device for tracking the interaction of the user's virtual scalpel and hand models. We used Unreal Engine to create and visualize such virtual laboratory. During the recognition "hand-pencil" system, the 3D scalpel model is activated in our VR and scene, with a collision in the proposed virtual blade area. The user manipulates such “hand-scalpel” system in VR and AR simulation process, where the collision area of blade interacts with an imitating an organic 3D object. In this paper we presented the sensitivity and efficiency of “hand-pencil” system inside the virtual scene. In addition, the comparison and application of the methodology were highlighted for VR and AR prototypes of the laboratory scene.

Paper Details

Date Published: 19 February 2020
PDF: 7 pages
Proc. SPIE 11310, Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR), 113101G (19 February 2020); doi: 10.1117/12.2546369
Show Author Affiliations
Larisa A. Zherdeva, Samara Univ. (Russian Federation)
Konstantin V. Cherepanov, Samara Univ. (Russian Federation)
Denis A. Zherdev, Samara Univ. (Russian Federation)
Image Processing Systems Institute (Russian Federation)

Published in SPIE Proceedings Vol. 11310:
Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR)
Bernard C. Kress; Christophe Peroz, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?