Skip to main content

Free Content Experimental phenomenology in the development of a colocative audio-visual display

This article describes the methodological background for perceptual studies conducted on the author’s Pixelphonic display ‐ a system that colocates visuals and their associated sounds in moving image displays. The concept of Pixelphonics is to add a spatial complement to synchronized sound, so that audio can now be in place with its image, in addition to being in time with it. Methods grounded in experimental phenomenology are used to better understand the general perceptual response to the system, which works by attaching a 2D array of audio exciters to the backside of a screen, connected to signal distribution and software. Findings show the general efficacy of the system and adequate perceptual resolution for further development and refinement of the display. One experiment is selected for discussion to illustrate the approach.

Keywords: audio-visual colocation; displays; experimental phenomenology; phenomenological psychophysics; ventriloquism effect; visual capture

Document Type: Research Article

Publication date: April 1, 2017

More about this publication?
  • The Soundtrack is a multi-disciplinary journal which brings together research in the area of music and sound in relation to film and other moving image media. A complex cultural, technological, industrial and artistic phenomenon, sound-with-moving image is a rich area for analysis, investigation and speculation. We encourage writing that is accessible to audiences from a diversity of intellectual backgrounds and disciplines as well as providing a forum for practitioners. The Soundtrack's aim is to nurture this new and expanding area of academic investigation in dialogue with soundtrack producers of all kinds.
  • Editorial Board
  • Information for Authors
  • Subscribe to this Title
  • Intellect Books page
  • Ingenta Connect is not responsible for the content or availability of external websites
  • Access Key
  • Free content
  • Partial Free content
  • New content
  • Open access content
  • Partial Open access content
  • Subscribed content
  • Partial Subscribed content
  • Free trial content