Cognition. 2005 May;96(1):B13-22. Epub 2004 Dec 30.

Audio-visual speech perception is special.

Tuomainen J, Andersen TS, Tiippana K, Sams M.

Source

Laboratory of Computational Engineering, University of Technology, P.O. Box 3000, FIN-02015 Helsinki, Finland. jyrtuoma@utu.fi

Abstract

In face-to-face conversation speech is perceived by ear and eye. We studied the prerequisites of audio-visual speech perception by using perceptually ambiguous sine wave replicas of natural speech as auditory stimuli. When the subjects were not aware that the auditory stimuli were speech, they showed only negligible integration of auditory and visual stimuli. When the same subjects learned to perceive the same auditory stimuli as speech, they integrated the auditory and visual stimuli in a similar manner as natural speech. These results demonstrate the existence of a multisensory speech-specific mode of perception.

PMID:: 15833302; [PubMed - indexed for MEDLINE]

Publication Types, MeSH Terms

Publication Types

Research Support, Non-U.S. Gov't

MeSH Terms

LinkOut - more resources

Full Text Sources

Other Literature Sources

Supplemental Content

Related citations

Integration efficiency for speech perception within and across sensory modalities by normal-hearing and hearing-impaired individuals. [J Acoust Soc Am. 2007]
Integration efficiency for speech perception within and across sensory modalities by normal-hearing and hearing-impaired individuals.
Grant KW, Tufts JB, Greenberg S. J Acoust Soc Am. 2007 Feb; 121(2):1164-76.
Audio-visual matching of speech and non-speech oral gestures in patients with aphasia and apraxia of speech. [Neuropsychologia. 2006]
Audio-visual matching of speech and non-speech oral gestures in patients with aphasia and apraxia of speech.
Schmid G, Ziegler W. Neuropsychologia. 2006; 44(4):546-55. Epub 2005 Aug 29.
Auditory and visual cueing of the [+/- rounded] feature of vowels. [Lang Speech. 1992]
Auditory and visual cueing of the [+/- rounded] feature of vowels.
Lisker L, Rossi M. Lang Speech. 1992 Oct-Dec; 35 ( Pt 4):391-417.
Review Lipreading and audio-visual speech perception. [Philos Trans R Soc Lond B Biol...]
Review Lipreading and audio-visual speech perception.
Summerfield Q. Philos Trans R Soc Lond B Biol Sci. 1992 Jan 29; 335(1273):71-8.
Review Theoretical contributions of tests on animals to the special-mechanisms debate in speech. [Exp Biol. 1986]
Review Theoretical contributions of tests on animals to the special-mechanisms debate in speech.
Kuhl PK. Exp Biol. 1986; 45(3):233-65.

See reviews... See all...

Cited by 3 PubMed Central articles

The effect of looming and receding sounds on the perceived in-depth orientation of depth-ambiguous biological motion figures. [PLoS One. 2011]
The effect of looming and receding sounds on the perceived in-depth orientation of depth-ambiguous biological motion figures.
Schouten B, Troje NF, Vroomen J, Verfaillie K. PLoS One. 2011 Feb 23; 6(2):e14725. Epub 2011 Feb 23.
Phonological universals constrain the processing of nonspeech stimuli. [J Exp Psychol Gen. 2010]
Phonological universals constrain the processing of nonspeech stimuli.
Berent I, Balaban E, Lennertz T, Vaknin-Nusbaum V. J Exp Psychol Gen. 2010 Aug; 139(3):418-35.
Audiovisual integration of speech in a bistable illusion. [Curr Biol. 2009]
Audiovisual integration of speech in a bistable illusion.
Munhall KG, ten Hove MW, Brammer M, Paré M. Curr Biol. 2009 May 12; 19(9):735-9. Epub 2009 Apr 2.

Related information

Related Citations
Calculated set of PubMed citations closely related to the selected article(s) retrieved using a word weight algorithm. Related articles are displayed in ranked order from most to least relevant, with the “linked from” citation displayed first.
Cited in PMC
Full-text articles in the PubMed Central Database that cite the current articles.

Recent activity

Clear Turn Off Turn On

Audio-visual speech perception is special.
Audio-visual speech perception is special.
Cognition. 2005 May ;96(1):B13-22. Epub 2004 Dec 30 .

PubMed
Cross-modal integration and plastic changes revealed by lip movement, random-dot...
Cross-modal integration and plastic changes revealed by lip movement, random-dot motion and sign languages in the hearing and deaf.
Cereb Cortex. 2005 Aug ;15(8):1113-22. Epub 2004 Nov 24 .

PubMed
DAGchainer: a tool for mining segmental genome duplications and synteny.
DAGchainer: a tool for mining segmental genome duplications and synteny.
Bioinformatics. 2004 Dec 12 ;20(18):3643-6. Epub 2004 Jul 9 .

PubMed
The relationship of cigarette smoking to peripheral arterial disease.
The relationship of cigarette smoking to peripheral arterial disease.
Rev Cardiovasc Med. 2004 Fall ;5(4):189-93.

PubMed
Cigarette smoking and hypertension.
Cigarette smoking and hypertension.
Curr Pharm Des. 2010 ;16(23):2518-25.

PubMed

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

PubMed

Display Settings:

Send to: