Conference 12125 > Paper 12125-5
Paper 12125-5

Virtual reality framework for design and evaluation of multispectral computer vision algorithms and augmented reality interfaces for enhancing situational awareness in degraded visual environments

4 April 2022 • 10:20 AM - 10:40 AM EDT

Abstract

A virtual reality framework for the design and evaluation of computer vision algorithms and augmented reality interfaces to enhance dismounted soldier situational awareness is described. Computer vision models process input from a “virtual camera” in-line with a rifle-mounted telescopic sight and augmented reality overlays are projected over the sight’s optics. Objective metrics, including physiological monitoring, are used to assess the impact of displays on soldier performance. To investigate how sensors beyond visible-wavelength optical imaging may be leveraged to enhance this capability, particularly in degraded visual environments, the virtual camera framework was extended to introduce methods for simulating multispectral infrared imaging.

Presenter

Riverside Research (United States)
Joseph Salisbury is a Research Scientist in Augmented and Virtual Reality at Riverside Research. He received his Ph.D. in Neuroscience from Brandeis University and performed post-doctoral research at Northeastern University. Dr. Salisbury has concentrated his career on AR/VR, computer vision, and wearable physiological monitoring systems since 2015. His work has included U.S. Department of Defense-funded research on a head-mounted wearable system for mild traumatic brain injury diagnosis and rehabilitation and a VR work readiness assessment for adults with intellectual and developmental disabilities. Dr. Salisbury also led the design and development of a wearable AR social-emotional learning system for children with autism and a VR post-stroke physical therapy system. Dr. Salisbury’s current work at Riverside Research combines virtual and augmented reality with artificial intelligence and machine learning with the goal of understanding and improving human-machine teaming.
Author
Riverside Research (United States)
Author
Riverside Research (United States)
Author
Riverside Research (United States)
Author
Riverside Research (United States)
Author
Riverside Research (United States)
Presenter/Author
Riverside Research (United States)