Voice Control in Mixed Reality

PubDate: October 2018

Teams: Institute of Mathematics Silesian University of Technology Kaszubska 23

Writers: Dawid Polap

PDF: Voice Control in Mixed Reality

Abstract

The gameplay in the augmented or virtual reality is based on the use of external equipment such as glasses/telephones and possibly the use of additional sensors or controllers. In both cases, the interaction involves pressing the keys on the phone or controller. An interesting aspect is the control of objects created in a virtual way using voice commands. In this paper, we propose a solution to manipulate objects in the augmented reality using player’s voice. The user can move the object using pre-programmed commands. The solution is based on speech processing and artificial neural networks. The technique has been tested and the results presented and discussed.