Head-mounted Augmented Reality for Guided Surface Reflectance Capture

PubDate: June 2020

Teams: Cornell Tech，Aarhus University，Facebook AI，Cornell University

Writers: Harald Haraldsson, Søren Skovsen, Ser-Nam Lim, Steve Marschner, Serge Belongie, Abe Davis

PDF: Head-mounted Augmented Reality for Guided Surface Reflectance Capture

Abstract

In this project, we explore the design of a system for helping users capture surface reflectance functions with a head-mounted augmented reality (AR) device and a hand-held controller. We supplement a standard 6-DOF controller with a mountable light source that we track during capture. Users begin by using the controller to select a surface region for capture. We then record images through the head-mounted camera while guiding the user’s control of the hand-held light source with real-time feedback through the AR display. Our system provides a simple and efficient way to capture information about surface reflectance in the wild.