Binaural Reproduction From Microphone Array Signals Incorporating Head-Tracking

PubDate: September 8, 2021

Teams: Facebook

Writers: Lior Madmoni, Jacob Donley, Vladimir Tourbabin, Boaz Rafaely

PDF: Binaural Reproduction From Microphone Array Signals Incorporating Head-Tracking

Abstract

Binaural reproduction over headphones is becoming popular with applications in teleconferencing, virtual reality and entertainment. Many binaural reproduction methods are developed and studied extensively for spherical and other specially-designed arrays. However, some applications require simpler arrays, such as wearable or mobile. Recently, a binaural reproduction method was developed for such arrays based on binaural signals matching (BSM). While showing that BSM can produce accurate binaural signals, the study was limited to two array configurations and head-tracking was not incorporated. As a follow-up, this paper studies BSM with a varying number of microphones in a semi-circular configuration and investigates a solution for head-tracking. Simulations show that placing two microphones close to the ear positions of the head related transfer functions significantly improves reproduction with a static head. However, microphones placed away from ear positions are needed for head-tracking. This is then subjectively studied in a listening experiment with a semi-circular array, showing that compensating for head-rotations is important for accurate spatial perception but may introduce timbral artifacts due to the limited number of microphones.