Share Email Print

Proceedings Paper

Artificial intelligence-based interactive virtual reality-assisted gaming system for hand rehabilitation
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Over the past few years, the use of the off-the-shelf video game platform as a rehabilitation tool has gained much interest in physiotherapy. In this paper, we describe an avenue for the integration of virtual reality (VR) and artificial intelligence (AI) based game tracking techniques applied for the purposes of improving the effectiveness of home-care hand physical therapy. We provide an overview of the software and hardware implementation of the prototype based on a LEAP motion sensor input device, which provides two 850nm wavelength infrared (IR) tracking cameras, and an Oculus virtual reality headset. In this initial study, an interactive game is developed on the Unity VR gaming platform that dynamically adjusts the levels of the game to the player performance based on adaptive hand gesture tracking and analysis Al algorithms. A preliminary game evaluation study is conducted on a human subject that showcases the efficiency of the proposed method.

Paper Details

Date Published: 2 March 2020
PDF: 9 pages
Proc. SPIE 11318, Medical Imaging 2020: Imaging Informatics for Healthcare, Research, and Applications, 113180J (2 March 2020); doi: 10.1117/12.2549372
Show Author Affiliations
Mayaank Pillai, Somerset County Vocational and Technical High School (United States)
Yilin Yang, Rutgers, The State Univ. of New Jersey (United States)
Corey Ditmars, Colombia Univ. (United States)
Hrebesh Subhash, Colgate Palmolive Global Technology Ctr. (United States)

Published in SPIE Proceedings Vol. 11318:
Medical Imaging 2020: Imaging Informatics for Healthcare, Research, and Applications
Po-Hao Chen; Thomas M. Deserno, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?