Format

Send to

Choose Destination
Neuroimage. 2014 Sep;98:425-34. doi: 10.1016/j.neuroimage.2014.04.077. Epub 2014 May 9.

Audio-visual synchrony modulates the ventriloquist illusion and its neural/spatial representation in the auditory cortex.

Author information

1
Institute of Biological Psychology, Otto-von-Guericke University, 39106 Magdeburg, Germany; Department of Child and Adolescent Psychiatry, Psychotherapy and Psychosomatics, Otto-von-Guericke University, 39120 Magdeburg, Germany.
2
Institute of Biological Psychology, Otto-von-Guericke University, 39106 Magdeburg, Germany; Center for Behavioral and Brain Sciences, 39120 Magdeburg, Germany.
3
Department of Child and Adolescent Psychiatry, Psychotherapy and Psychosomatics, Otto-von-Guericke University, 39120 Magdeburg, Germany.
4
Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke-University, 39120 Magdeburg, Germany.
5
Department of Neurology, Otto-von-Guericke University, 39120 Magdeburg, Germany.
6
Department of Neurosciences, UC San Diego, 9500 Gilman Dr. 0634, La Jolla, CA 92093, USA.

Abstract

An essential task of our perceptual systems is to bind together the distinctive features of single objects and events into unitary percepts, even when those features are registered in different sensory modalities. In cases where auditory and visual inputs are spatially incongruent, they may still be perceived as belonging to a single event at the location of the visual stimulus - a phenomenon known as the 'ventriloquist illusion'. The present study examined how audio-visual temporal congruence influences the ventriloquist illusion and characterized its neural underpinnings with functional magnetic resonance imaging (fMRI). Behaviorally, the ventriloquist illusion was reduced for asynchronous versus synchronous audio-visual stimuli, in accordance with previous reports. Neural activity patterns associated with the ventriloquist effect were consistently observed in the planum temporale (PT), with a reduction in illusion-related fMRI-signals ipsilateral to visual stimulation for central sounds perceived peripherally and a contralateral increase in illusion-related fMRI-signals for peripheral sounds perceived centrally. Moreover, it was found that separate but adjacent regions within the PT were preferentially activated for ventriloquist illusions produced by synchronous and asynchronous audio-visual stimulation. We conclude that the left-right balance of neural activity in the PT represents the neural code that underlies the ventriloquist illusion, with greater activity in the cerebral hemisphere contralateral to the direction of the perceived shift of sound location.

[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Elsevier Science
Loading ...
Support Center