Conference 12125 > Paper 12125-4
Paper 12125-4

3D telexistence system for real-time remote object interaction in hazardous environments with a light field display, GPU and depth camera via a wireless LAN

4 April 2022 • 10:00 AM - 10:20 AM EDT

Abstract

An eXtreme Reality (XR) 3D telexistence system is demonstrated, based on a Looking Glass light field display and a mobile robotic vehicle equipped with an Intel RealSense depth camera over a wireless Local Area Network (WLAN). Real-time 3D streaming of a full colour point cloud video with depth, audio and control data is achieved at 30 fps at 129 Mbps. A digital twin of the remote vehicle working in a synthetic simulated environment is also shown. The telexistence system enables humans to work remotely and operate machinery in complex hazardous environments with applications in de-mining, bomb disposal, nuclear decommissioning and space exploration.

Presenter

Holoxica Ltd. (United Kingdom)
Christopher is a graduate of the CDT in Applied Photonics at Heriot Watt, with over 5 years experience in holographic 3D display hardware and 3D graphics programming. He also holds an MPhys from the University of St Andrews specialising in photonic applications for a total of a decade of higher education and industrial experience. He is a Holographics System Engineer at Holoxica Ltd., where for the past 4 years he has been a core part of several professional projects. These include the development of volumetric display hardware, light field display hardware, and compatible 3D graphics applications in JavaScript / Node.js. He is also skilled in Python, LabVIEW, FORTRAN, Mathematica, and MATLAB. His current focus is on developing cutting-edge software applications for visualising 3D data of many forms, from static models to live data streamed over the internet, utilising light-field display hardware to allow for natural, glasses-free 3D viewing experiences.
Presenter/Author
Holoxica Ltd. (United Kingdom)
Author
The Univ. of Edinburgh (United Kingdom), Holoxica Ltd. (United Kingdom)
Author
Defence Science and Technology Lab. (United Kingdom)
Author
Holoxica Ltd. (United Kingdom)