Virtual Sound Imaging Using Visually Adaptive Loudspeakers

Advances in computer technology and low cost cameras open up new possibilities for three dimensional (3D) sound reproduction. The idea is to create 3D sound using loudspeakers and visual tracking of the position of the listener. Previously, applications of binaural technology using loudspeakers have been limited due to the small sweet spot of such systems. Recently visual tracking has emerged as a feasible option for overcoming these limitations. Although it is a difficult task to predict the position of the listener relative to the loudspeakers in any given situation, under certain conditions it is possible to track the position of the listener relative to the loudspeakers. Here it is shown that it is possible to track the position of a listener that is not wearing any sensors by using image processing techniques, while the audio system is adapted using filter update techniques that are seamless as far as the audible perception of the listener is concerned.