Glossy Reflections for Mixed Reality Environments on Mobile Devices

PubDate: December 2018

Teams: Ilmenau University of Technology

Writers: Tobias Schwandt; Christian Kunert; Wolfgang Broll

PDF: Glossy Reflections for Mixed Reality Environments on Mobile Devices

Abstract

Glossy reflections of the surroundings play a major role when trying to achieve a seamless fusion of real and virtual objects in Mixed Reality (MR) environments. Traditionally, the necessary information about the ambiance is captured using mirrored balls, HDR cameras, fish-eye lenses, RGB-D cameras or 360-degree cameras. While these approaches allow for pretty good results, they require a rather complex setup. Our approach is based on a single RGB camera capturing the environmental lighting at a certain location within the scene. Therefore, we apply a precomputation step generating a 360-degree environment map and combine it with a camera-based image stitching for a continuous enhancement and update of the lighting information. We show that our approach allows for realistic and high-quality reflections within an AR/MR environment in real time even on mobile devices.