Stick-To-XR: Understanding Stick-Based User Interface Design for Extended Reality

Date：June 2024

Teams:Microsoft；Xi'an Jiaotong-Liverpool University

Writers:Yaying Zhang, Rongkai Shi, and Hai-Ning Liang

PDF:Stick-To-XR: Understanding Stick-Based User Interface Design for Extended Reality

Abstract

This work explores the design of stick-shaped Tangible User Interfaces (TUI) for Extended Reality (XR). While sticks are widely used in everyday objects, their applications as a TUI in XR have not been systematically studied. We conducted a participatory design session with twelve experts in XR and human-computer interaction to investigate the affordances of stick-based objects and how to utilize them in XR. The results led us to develop a taxonomy of stick-based objects’ affordances in terms of their functions and holding gestures. Following that, we proposed four types of stick-based XR controller forms and discussed their advantages and limitations. In the end, we juxtaposed twenty-six existing XR controllers against our proposed forms and identified Landed (Cane) Stick, Thin Stick’s flexible usages, and Modular Design as the major opportunities that remain unexamined yet for stick-based XR TUI design.