Spatial audio systems are typically evaluated in comparative listening tests using the same source signal for each condition such as ABX: ITU-R BS. 1116-3 (2015a) Methods for the Subjective Assessment of Small Impairments in Audio Systems (International Telecommunication Union, Geneva, Switzerland) and multiple stimulus with hidden reference and anchor ITU-R BS. 1534-3 (2015b) Methods for the Subjective Assessment of Intermediate Quality Level of Audio Systems (International Telecommunication Union, Geneva, Switzerland). However, in augmented reality (AR) scenarios, it is infeasible that the same sound source would exist at the same position in space, both real and virtual; instead, each sound source will emit a different signal. To investigate this discrepancy, a perceptual study is conducted on the effect of source signal similarity when distinguishing different room acoustics conditions. Specifically, these conditions are binaural room impulse responses measured at different distances from the source, modified to all use the same direct sound. Three classes of source signal are investigated in a three-alternative forced choice paradigm: the same speech signal for all conditions, the same speaker but a different sentence for each condition, and a different speaker and a different sentence for each condition. Results show that using different speech recordings significantly reduces the ability to identify differences in room acoustics. This suggests that spatial audio system fidelity requirements could vary depending on the source signals used in the target application; AR audio evaluation should use different signals for comparisons.
McKenzie et al. (Sun,) studied this question.