Head-Coupled Kinematic Template Matching: A Prediction Model for Ray Pointing in VR

Title: Head-Coupled Kinematic Template Matching: A Prediction Model for Ray Pointing in VR

Teams: Facebook

Writers: Rorik Henrikson, Tovi Grossman, Sean Trowbridge, Daniel Wigdor, Hrvoje Benko

Publication date: April 27, 2020

Abstract

This paper presents a new technique to predict the ray pointer landing position for selection movements in virtual reality (VR) environments. The technique adapts and extends a prior 2D kinematic template matching method to VR environments where ray pointers are used for selection. It builds on the insight that the kinematics of a controller and HeadMounted Display (HMD) can be used to predict the ray’s final landing position and angle. An initial study provides evidence that the motion of the head is a key input channel for improving prediction models. A second study validates this technique across a continuous range of distances, angles, and target sizes. On average, the technique’s predictions were within 7.3° of the true landing position when 50% of the way through the movement and within 3.4° when 90%. Furthermore, compared to a direct extension of Kinematic Template Matching, which only uses controller movement, this head-coupled approach increases prediction accuracy by a factor of 1.8x when 40% of the way through the movement.