Postersession 2
Poster #: 80
Topic: MMN across modalities
Thursday, Sep 10, 2015
1st floor

The ventriloquist effect evokes changes in the early spatial processing of auditory stimuli as measured by the mismatch negativity

Daryl Kelvasa1, Jens Ahrens2, & Jan-Niklas Antons2

1Oldenburg, Germany
2Quality and Usability Lab, Technische Universität Berlin, Germany

The Ventriloquist Effect arises when synchronous auditory and visual events occur with spatial discrepancy and the location of the visual event biases the perceived location of the auditory event. The mismatch negativity (MMN) has been shown to be effective in tracking changes in spatial location of both auditory and visual stimuli by examining peaks of standard and deviant difference waves occurring within 200 ms after stimulus presentation. We present an audio visual MMN experiment in which we attempt to induce an auditory MMN by shifting only the location of the visual stimulus. The standard condition consisted of visual and auditory stimuli originating from 0°, -10°, and 10°. The deviant condition held the auditory stimulus in the same location while shifting the visual stimuli to -20° and 20°, 10°, and 10° respectively. Auditory stimuli were presented by a software system for spatial audio reproduction that created two dimensional virtual acoustic scenes and employed head tracking for added robustness. In addition, auditory and visual only conditions were collected to serve as comparisons to the audio visual difference waves. An auditory MMN was successfully induced in the peripheral audio visual condition, supporting other findings that cross-modal processing can elicit changes in the early pre-attentive processing of stimuli.