Share Email Print

Proceedings Paper

Improving motion sickness severity classification through multi-modal data fusion
Author(s): Mark Dennison Jr.; Mike D'Zmura; Andre Harrison; Michael Lee; Adrienne Raglin
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Head mounted displays (HMD) may prove useful for synthetic training and augmentation of military C5ISR decisionmaking. Motion sickness caused by such HMD use is detrimental, resulting in decreased task performance or total user dropout. The genesis of sickness symptoms is often measured using paper surveys, which are difficult to deploy in live scenarios. Here, we demonstrate a new way to track sickness severity using machine learning on data collected from heterogeneous, non-invasive sensors worn by users who navigated a virtual environment while remaining stationary in reality. We discovered that two models, one trained on heterogeneous sensor data and another trained only on electroencephalography (EEG) data, were able to classify sickness severity with over 95% accuracy and were statistically comparable in performance. Greedy feature optimization was used to maximize accuracy while minimizing the feature subspace. We found that across models, the features with the most weight were previously reported in the literature as being related to motion sickness severity. Finally, we discuss how models constructed on heterogeneous vs homogeneous sensor data may be useful in different real-world scenarios.

Paper Details

Date Published: 10 May 2019
PDF: 10 pages
Proc. SPIE 11006, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications, 110060T (10 May 2019); doi: 10.1117/12.2519085
Show Author Affiliations
Mark Dennison Jr., U.S. Army Research Lab. (United States)
Mike D'Zmura, Univ. of California, Irvine (United States)
Andre Harrison, U.S. Army Research Lab. (United States)
Michael Lee, U.S. Army Research Lab. (United States)
Adrienne Raglin, U.S. Army Research Lab. (United States)

Published in SPIE Proceedings Vol. 11006:
Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications
Tien Pham, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?