Attention controls multisensory perception via two distinct mechanisms at different levels of the cortical hierarchy

PLoS Biol. 2021 Nov 18;19(11):e3001465. doi: 10.1371/journal.pbio.3001465. eCollection 2021 Nov.

Abstract

To form a percept of the multisensory world, the brain needs to integrate signals from common sources weighted by their reliabilities and segregate those from independent sources. Previously, we have shown that anterior parietal cortices combine sensory signals into representations that take into account the signals' causal structure (i.e., common versus independent sources) and their sensory reliabilities as predicted by Bayesian causal inference. The current study asks to what extent and how attentional mechanisms can actively control how sensory signals are combined for perceptual inference. In a pre- and postcueing paradigm, we presented observers with audiovisual signals at variable spatial disparities. Observers were precued to attend to auditory or visual modalities prior to stimulus presentation and postcued to report their perceived auditory or visual location. Combining psychophysics, functional magnetic resonance imaging (fMRI), and Bayesian modelling, we demonstrate that the brain moulds multisensory inference via two distinct mechanisms. Prestimulus attention to vision enhances the reliability and influence of visual inputs on spatial representations in visual and posterior parietal cortices. Poststimulus report determines how parietal cortices flexibly combine sensory estimates into spatial representations consistent with Bayesian causal inference. Our results show that distinct neural mechanisms control how signals are combined for perceptual inference at different levels of the cortical hierarchy.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adolescent
  • Adult
  • Attention / physiology*
  • Bayes Theorem
  • Cerebral Cortex / physiology*
  • Female
  • Humans
  • Magnetic Resonance Imaging
  • Male
  • Multivariate Analysis
  • Oxygen / blood
  • Sensation / physiology*
  • Time Factors
  • Young Adult

Substances

  • Oxygen

Grants and funding

This research was funded by the European Research Council (https://erc.europa.eu/; grant number: ERC-2012-StG_20111109 multsens to UN). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.