Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information

J Neurosci. 2006 Nov 22;26(47):12260-5. doi: 10.1523/JNEUROSCI.1457-06.2006.

Abstract

Previous studies have shown that processing information in one sensory modality can either be enhanced or attenuated by concurrent stimulation of another modality. Here, we reconcile these apparently contradictory results by showing that the sign of cross-modal interactions depends on whether the content of two modalities is associated or not. When concurrently presented auditory and visual stimuli are paired by chance, cue-induced preparatory neural activity is strongly enhanced in the task-relevant sensory system and suppressed in the irrelevant system. Conversely, when information in the two modalities is reliably associated, activity is enhanced in both systems regardless of which modality is task relevant. Our findings illustrate an ecologically optimal flexibility of the neural mechanisms that govern multisensory processing: facilitation occurs when integration is expected, and suppression occurs when distraction is expected. Because thalamic structures were more active when the senses needed to operate separately, we propose them to serve gatekeeper functions in early cross-modal interactions.

Publication types

  • Comparative Study

MeSH terms

  • Acoustic Stimulation / methods
  • Adult
  • Afferent Pathways / blood supply
  • Afferent Pathways / physiology*
  • Auditory Cortex / blood supply
  • Auditory Cortex / physiology*
  • Brain Mapping
  • Cues
  • Female
  • Humans
  • Image Processing, Computer-Assisted / methods
  • Magnetic Resonance Imaging / methods
  • Male
  • Oxygen / blood
  • Photic Stimulation / methods
  • Reaction Time / physiology
  • Thalamus / blood supply
  • Thalamus / physiology
  • Visual Cortex / blood supply
  • Visual Cortex / physiology*

Substances

  • Oxygen