Batmen X The Puzzler – Escaping AR’s Drawbacks with Augmented Virtuality and Low Cost Sensors

PubDate: March 2019

Teams: Universidade de São Paulo

Writers: André Montes Rodrigues ; Mário Nagamura ; Luis Gustavo Freire Da Costa ; Rodrigo Rodrigues Gesuatto Faria ; Pier Luigi Nakai Ricchetti, Eric Nozomi Tatsuta, Roseli de Deus Lopes, Marcelo Knorich Zuffo

PDF: Batmen X The Puzzler – Escaping AR’s Drawbacks with Augmented Virtuality and Low Cost Sensors

Abstract

We present an augmented virtuality system using low-cost or outdated devices as sensors, attached to tangible objects. Five interactions were implemented, featuring rotation, pressing, pulling, pushing and insertion movements, including passive mechanical resistance. Interactions were tied together by a puzzling narrative. Concerning storytelling, in contrast to AR, pure virtual reality offers unlimited visual possibilities and higher flexibility. Augmenting VR with physical objects allows ignoring most details of the physical environment and exploring ‘magical’ interactions. Precise registration was accomplished using wireless tracking system. The main challenge was the absent physical counterparts of the scenario, which was tackled by limiting user’s reach to available interactions. Despite Leap Motion’s erratic hand tracking, mouse and tablet sensors were precise enough and the augmented environment allowed a high sense of presence.