Mobile augmented reality for providing perception of materials

PubDate: November 2017

Teams: Saitama University；Tokyo Metropolitan College of Industrial Technology；Chiba University

Writers: Ryota Nomura；Yuko Unuma；Takashi Komuro；Shoji Yamamoto；Norimichi Tsumura

PDF: Mobile augmented reality for providing perception of materials

Abstract

In this paper, we propose an AR system using a mobile display that allows the user to manipulate a virtual object using the user’s own hand to provide the user with perception of materials. To realize more natural interaction with a virtual object, our proposed system provides visual information that is consistent with the user’s somatic sensation by displaying user-perspective images on the mobile display. The system allows the user to manipulate the virtual object with six degrees of freedom (three degrees of freedom for translation and three degrees of freedom for rotation) by mapping the hand pose to the object’s translation and rotation. Material appearance of objects is presented by rendering the virtual object using Unity 3D. We showed the effectiveness of our proposed system by showing how the user manipulates the virtual object and obtains the gloss and burnish of the object using the proposed system.