HandPoseMenu: Hand Posture-Based Virtual Menus for Changing Interaction Mode in 3D Space
PubDate: November 2019
Teams: Electronics and Telecommunications Research Institute
Writers: Chanho Park;Hyunwoo Cho;Sangheon Park;Young-Suk Yoon;Sung-Uk Jung
PDF: HandPoseMenu: Hand Posture-Based Virtual Menus for Changing Interaction Mode in 3D Space
Abstract
A system control technique (changing the interaction mode) is needed to provide various spatial interaction techniques for virtual, augmented and mixed reality (VR/AR/MR) applications. We propose HandPoseMenu, a hand posture-based virtual menus system in 3D space. HandPoseMenu recognizes the non-dominant hand’s posture using a depth sensor that is attached to a wearable display and presents the virtual menu corresponding to the hand posture beside the non-dominant hand. When the user selects a desired function among the presented menu as a dominant hand, the interaction mode changes. The combination of the two system controls (graphical menu and hand posture) makes it possible to display the menu that the user wants to use in 3D space. This paper describes the implementation of HandPoseMenu and its application.