Comparative Study of Latent-Sensitive Processing of Heterogeneous Data in an Experimental Platform for 3D Video Holographic Communication
PubDate: May 2022
Teams: Technical University of Sofia
Writers: Nikola Petkov; Nicole Christoff; Agata Manolova; Krasimir Tonchev; Vladimir Poulkov
Abstract
Holographic communication is a complete human-computer-machine interface that combines augmented reality and virtual reality telepresence to create real-life digital scans and realistic 3D avatars of subjects that are displayed in a mixed reality environment and used for real-time communication and interaction between remote users. The latency that exists while relaying the realistic impression of presence in a remote location to a local human user is impeding the acceptability of immersive telepresence systems. Motion sickness, caused by the misalignment between the user’s motion and the visual response, is one of the main reasons for the slow adoption of these systems. In this paper we explore two use case scenarios to measure the calculated transmission time of heterogeneous data, including key points of the 3D model of the body, face or hands, so as to meet the limitations of bandwidth and latency in current and future networks. Depending on the way the information is transmitted and received, the speed of transmission and the amount of information, as well as other important factors, different modes of operation for the proposed experimental platform are considered, allowing it to be flexible by adapting to the available resources.
