Lost in Style:Gaze-driven Adaptive Aid for VR Navigation

Title: Lost in Style:Gaze-driven Adaptive Aid for VR Navigation

Teams: GEORGE MASON UNIVERSITY, 2JAPAN BROADCASTING CORPORATION, 3UNIVERSITY OF MASSACHUSETTS-BOSTON, 4NATIONAL CHIAO TUNG UNIVERSITY, 5FACEBOOK REALITY LABS

Writers: RAWAN ALGHOFAILI1, YASUHITO SAWAHATA2, HAIKUN HUANG3, HSUEH-CHENG WANG4, TAKAAKI SHIRATORI5, LAP-FAI YU1

Publication date: May 2019

Abstract

A key challenge for virtual reality level designers is striking a balance between maintaining the immersiveness of VR and providing users with on-screen aids after designing a virtual experience. These aids are often necessary for wayfinding in virtual environments with complex paths.

We introduce a novel adaptive aid that maintains the effectiveness of traditional aids, while equipping designers and users with the controls of how often help is displayed. Our adaptive aid uses gaze patterns in predicting user’s need for navigation aid in VR and displays mini-maps or arrows accordingly. Using a dataset of gaze angle sequences of users navigating a VR environment and markers of when users requested aid, we trained an LSTM to classify user’s gaze sequences as needing navigation help and display an aid. We validated the efficacy of the adaptive aid for wayfinding compared to other commonly-used wayfinding aids.