Augmented/Mixed Reality Audio for Hearables: Sensing, control, and rendering

PubDate: May 2022

Teams: Nanyang Technological University；Technical University Ilmenau；Aalto University

Writers: Rishabh Gupta; Jianjun He; Rishabh Ranjan; Woon-Seng Gan; Florian Klein; Christian Schneiderwind; Annika Neidhardt; Karlheinz Brandenburg；Vesa Välimäki

PDF: Augmented/Mixed Reality Audio for Hearables: Sensing, control, and rendering

Abstract

Augmented or mixed reality (AR/MR) is emerging as one of the key technologies in the future of computing. Audio cues are critical for maintaining a high degree of realism, social connection, and spatial awareness for various AR/MR applications, such as education and training, gaming, remote work, and virtual social gatherings to transport the user to an alternate world called the metaverse. Motivated by a wide variety of AR/MR listening experiences delivered over hearables, this article systematically reviews the integration of fundamental and advanced signal processing techniques for AR/MR audio to equip researchers and engineers in the signal processing community for the next wave of AR/MR.