Format

Send to

Choose Destination
eNeuro. 2018 Jan 19;5(1). pii: ENEURO.0294-17.2018. doi: 10.1523/ENEURO.0294-17.2018. eCollection 2018 Jan-Feb.

Neural Correlates of Temporal Complexity and Synchrony during Audiovisual Correspondence Detection.

Author information

1
Queensland Brain Institute, The University of Queensland, St Lucia, Queensland 4072, Australia.
2
QIMR Berghofer Medical Research Institute, Herston, Queensland 4006, Australia.
3
School of Automation, Northwestern Polytechnical University, Xi'an Shi 710065, China.

Abstract

We often perceive real-life objects as multisensory cues through space and time. A key challenge for audiovisual integration is to match neural signals that not only originate from different sensory modalities but also that typically reach the observer at slightly different times. In humans, complex, unpredictable audiovisual streams lead to higher levels of perceptual coherence than predictable, rhythmic streams. In addition, perceptual coherence for complex signals seems less affected by increased asynchrony between visual and auditory modalities than for simple signals. Here, we used functional magnetic resonance imaging to determine the human neural correlates of audiovisual signals with different levels of temporal complexity and synchrony. Our study demonstrated that greater perceptual asynchrony and lower signal complexity impaired performance in an audiovisual coherence-matching task. Differences in asynchrony and complexity were also underpinned by a partially different set of brain regions. In particular, our results suggest that, while regions in the dorsolateral prefrontal cortex (DLPFC) were modulated by differences in memory load due to stimulus asynchrony, areas traditionally thought to be involved in speech production and recognition, such as the inferior frontal and superior temporal cortex, were modulated by the temporal complexity of the audiovisual signals. Our results, therefore, indicate specific processing roles for different subregions of the fronto-temporal cortex during audiovisual coherence detection.

KEYWORDS:

audiovisual; fMRI; human; multisensory

PMID:
29354682
PMCID:
PMC5773885
DOI:
10.1523/ENEURO.0294-17.2018
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for PubMed Central
Loading ...
Support Center