A Dynamically Weighted Multi-Objective Optimization Approach to Positional Interactions in Remote-Local Augmented/Mixed Reality
PubDate: December 2021
Teams: Vanderbilt University
Writers: Akshith Ullal; Cadence Watkins; Nilanjan Sarkar
Abstract
With the rise in remote work culture and increased computing capabilities of head-mounted displays (HMDs), more immersive, collaborative experiences are desired in remote-local mixed/augmented (MR/AR) reality. Photorealistic full-body avatar representations of users in remote workspace interactions have shown to have increased social presence, non-verbal behavior, and engagement. However, a direct mapping of the body pose angles from local to the remote workspace will, in most cases, result in positional errors during human-object interaction, caused by the dissimilarity between remote and local workspaces. Hence the interaction must be retargeted, but it should be retargeted in such a way that the original intent of the body pose should be preserved. However, these two objectives sometimes contradict each other. As a result, a multi-objective optimization (MO) problem can be formulated where the primary objective is to minimize positional errors and the secondary objective is to preserve the original interaction body pose. The current state-of-the-art solution uses an evolutionary computation-based inverse kinematic (IK) approach to solve the MO problem where the weights between the objectives must be set by the user based on trial and error, leading to a suboptimal solution. In this paper, we present a new dynamic weight allocation approach to this problem, where a user has the flexibility to set a chosen minimum error tolerance, and the weights will be distributed between the objectives based on a dynamic allocation algorithm. We have tested the adaptability and robustness of this mechanism on motion captured human animations of varying levels of speeds, error tolerances, and redirections. Compared to the static weighting, the dynamic weighted mechanism shows a net (primary + secondary objective) decrease in error ranging from 20.5 % to 34.4% across varying animation speeds and redirections resulting in decreased positional errors and better pose preservation across interactions.
