Augmented/Mixed Reality Audio for Hearables: Sensing, control, and rendering
PubDate: May 2022
Teams: Nanyang Technological University；Technical University Ilmenau；Aalto University
Writers: Rishabh Gupta; Jianjun He; Rishabh Ranjan; Woon-Seng Gan; Florian Klein; Christian Schneiderwind; Annika Neidhardt; Karlheinz Brandenburg；Vesa Välimäki
Augmented or mixed reality (AR/MR) is emerging as one of the key technologies in the future of computing. Audio cues are critical for maintaining a high degree of realism, social connection, and spatial awareness for various AR/MR applications, such as education and training, gaming, remote work, and virtual social gatherings to transport the user to an alternate world called the metaverse. Motivated by a wide variety of AR/MR listening experiences delivered over hearables, this article systematically reviews the integration of fundamental and advanced signal processing techniques for AR/MR audio to equip researchers and engineers in the signal processing community for the next wave of AR/MR.