Towards Eye-Perspective Rendering for Optical See-Through Head-Mounted Displays

PubDate: April 2022

Teams: Salzburg University of Applied Sciences；University of Otago；Graz University of Technology

Writers: Gerlinde Emsenhuber; Michael Domhardt; Tobias Langlotz; Denis Kalkofen; Markus Tatzgern

PDF: Towards Eye-Perspective Rendering for Optical See-Through Head-Mounted Displays

Abstract

The optical see-through (OST) head-mounted display (HMD) is a typical platform for Augmented Reality (AR) and allows users to experience virtual augmentations in a wearable form factor. Utilizing information of the real-world background, visualization algorithms adapt the layout and representation of content to improve legibility. Typically, this background information is captured via built-in HMD cameras. However, HMD camera views of the real-world scene are distinctively different to the user’s view through the OST display. In this work, we propose eye-perspective rendering (EPR) as a solution to synthesize high fidelity renderings of the user’s view for mobile OST HMD to enable adaptation algorithms to utilize visual information as seen from the perspective of the user to improve placement, rendering and, thus, legibility of content.