NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.
It has become accepted in the neuroscience community that perception and performance are quintessentially multisensory by nature. Using the full palette of modern brain imaging and neuroscience methods, The Neural Bases of Multisensory Processes details current understanding in the neural bases for these phenomena as studied across species, stages of development, and clinical statuses.
Organized thematically into nine subsections, the book is a collection of contributions by leading scientists in the field. Chapters build generally from basic to applied, allowing readers to ascertain how fundamental science informs the clinical and applied sciences.
Topics discussed include
- Anatomy, essential for understanding the neural substrates of multisensory processing
- Neurophysiological bases and how multisensory stimuli can dramatically change the encoding processes for sensory information
- Combinatorial principles and modeling, focusing on efforts to gain a better mechanistic handle on multisensory operations and their network dynamics
- Development and plasticity
- Clinical manifestations and how perception and action are affected by altered sensory experience
- Attention and spatial representations
The last sections of the book focus on naturalistic multisensory processes in three separate contexts: motion signals, multisensory contributions to the perception and generation of communication signals, and how the perception of flavor is generated. The text provides a solid introduction for newcomers and a strong overview of the current state of the field for experts.
Contents
- Series Preface
- Introduction
- Editors
- Contributors
- I. Anatomy
- 1. Structural Basis of Multisensory Processing: ConvergenceH. Ruth Clemo, Leslie P. Keniston, and M. Alex Meredith.
- 2. Cortical and Thalamic Pathways for Multisensory and Sensorimotor InterplayCéline Cappe, Eric M. Rouiller, and Pascal Barone.
- 3. What Can Multisensory Processing Tell Us about the Functional Organization of Auditory
Cortex?Jennifer K. Bizley and Andrew J. King.
- 3.1 INTRODUCTION
- 3.2 FUNCTIONAL SPECIALIZATION WITHIN AUDITORY CORTEX?
- 3.3 FERRET AUDITORY CORTEX: A MODEL FOR MULTISENSORY PROCESSING
- 3.4 WHERE DO VISUAL INPUTS TO AUDITORY CORTEX COME FROM?
- 3.5 WHAT ARE THE PERCEPTUAL CONSEQUENCES OF MULTISENSORY INTEGRATION IN THE AUDITORY CORTEX?
- 3.6 CONDUDING REMARKS
- REFERENCES
- 1. Structural Basis of Multisensory Processing: Convergence
- II. Neurophysiological Bases
- 4. Are Bimodal Neurons the Same throughout the Brain?M. Alex Meredith, Brian L. Allman, Leslie P. Keniston, and H. Ruth Clemo.
- 5. Audiovisual Integration in Nonhuman Primates: A Window into the Anatomy and Physiology of CognitionYoshinao Kajikawa, Arnaud Falchier, Gabriella Musacchia, Peter Lakatos, and Charles E. Schroeder.
- 5.1 BEHAVIORAL CAPACITIES
- 5.2 NEUROANATOMICAL AND NEUROPHYSIOLOGICAL SUBSTRATES
- 5.3 FUNCTIONAL SIGNIFICANCE OF MULTISENSORY INTERACTIONS
- 5.4 PRINCIPLES OF MULTISENSORY INTERACTION
- 5.5 MECHANISMS AND DYNAMICS OF MULTISENSORY INTERACTION
- 5.6 IMPORTANCE OF SALIENCE IN LOW-LEVEL MULTISENSORY INTERACTIONS
- 5.7 CONCLUSIONS, UNRESOLVED ISSUES, AND QUESTIONS FOR FUTURE STUDIES
- REFERENCES
- 6. Multisensory Influences on Auditory Processing: Perspectives from fMRI and ElectrophysiologyChristoph Kayser, Christopher I. Petkov, Ryan Remedios, and Nikos K. Logothetis.
- 6.1 INTRODUCTION
- 6.2 THE WHERE AND HOW OF SENSORY INTEGRATION
- 6.3 USING FUNCTIONAL IMAGING TO LOCALIZE MULTISENSORY INFLUENCES IN AUDITORY CORTEX
- 6.4 MULTISENSORY INFLUENCES ALONG THE AUDITORY PROCESSING STREAM
- 6.5 MULTISENSORY INFLUENCES AND INDIVIDUAL NEURONS
- 6.6 MULTISENSORY INFLUENCES AND PROCESSING OF COMMUNICATION SIGNALS
- 6.7 CONCLUSIONS
- REFERENCES
- 7. Multisensory Integration through Neural CoherenceAndreas K. Engel, Daniel Senkowski, and Till R. Schneider.
- 8. The Use of fMRI to Assess Multisensory IntegrationThomas W. James and Ryan A. Stevenson.
- 9. Perception of Synchrony between the SensesMirjam Keetels and Jean Vroomen.
- 9.1 INTRODUCTION
- 9.2 MEASURING INTERSENSORY SYNCHRONY: TEMPORAL ORDER JUDGMENT TASK AND SIMULTANEITY JUDGMENT TASK
- 9.3 POINT OF SUBJECTIVE SIMULTANEITY
- 9.4 SENSITIVITY FOR INTERSENSORY ASYNCHRONY
- 9.5 HOW THE BRAIN DEALS WITH LAGS BETWEEN THE SENSES
- 9.6 TEMPORAL SYNCHRONY: AUTOMATIC OR NOT?
- 9.7 NEURAL SUBSTRATES OF TEMPORAL SYNCHRONY
- 9.8 CONCLUSIONS
- REFERENCES
- 10. Representation of Object Form in Vision and TouchSimon Lacey and Krish Sathian.
- 4. Are Bimodal Neurons the Same throughout the Brain?
- III. Combinatorial Principles and Modeling
- 11. Spatial and Temporal Features of Multisensory Processes: Bridging Animal and Human StudiesDiana K. Sarko, Aaron R. Nidiffer, Albert R. Powers III, Dipanwita Ghose, Andrea Hillock-Dunn, Matthew C. Fister, Juliane Krueger, and Mark T. Wallace.
- 11.1 INTRODUCTION
- 11.2 NEUROPHYSIOLOGICAL STUDIES IN ANIMAL MODELS: INTEGRATIVE PRINCIPLES AS A FOUNDATION FOR UNDERSTANDING MULTISENSORY INTERACTIONS
- 11.3 NEUROPHYSIOLOGICAL STUDIES IN ANIMAL MODELS: NEW INSIGHTS INTO INTERDEPENDENCE OF INTEGRATIVE PRINCIPLES
- 11.4 STUDYING MULTISENSORY INTEGRATION IN AN AWAKE AND BEHAVING SETTING: NEW INSIGHTS INTO UTILITY OF MULTISENSORY PROCESSES
- 11.5 HUMAN BEHAVIORAL AND PERCEPTUAL STUDIES OF MULTISENSORY PROCESSING: BUILDING BRIDGES BETWEEN NEUROPHYSIOLOGICAL AND BEHAVIORAL AND PERCEPTUAL LEVELS OF ANALYSIS
- 11.6 ADULT PLASTICITY IN MULTISENSORY TEMPORAL PROCESSES: PSYCHOPHYSICAL AND NEUROIMAGING EVIDENCE
- 11.7 DEVELOPMENTAL PLASTICITY IN MULTISENSORY REPRESENTATIONS: INSIGHTS FROM ANIMAL AND HUMAN STUDIES
- 11.8 CONCLUSIONS AND FUTURE DIRECTIONS
- REFERENCES
- 12. Early Integration and Bayesian Causal Inference in Multisensory PerceptionLadan Shams.
- 12.1 INTRODUCTION
- 12.2 EARLY AUDITORY–VISUAL INTERACTIONS IN HUMAN BRAIN
- 12.3 WHY HAVE CROSS-MODAL INTERACTIONS?
- 12.4 THE PROBLEM OF CAUSAL INFERENCE
- 12.5 SPECTRUM OF MULTISENSORY COMBINATIONS
- 12.6 PRINCIPLES GOVERNING CROSS-MODAL INTERACTIONS
- 12.7 CAUSAL INFERENCE IN MULTISENSORY PERCEPTION
- 12.8 HIERARCHICAL BAYESIAN CAUSAL INFERENCE MODEL
- 12.9 RELATIONSHIP WITH NONHIERARCHICAL CAUSAL INFERENCE MODEL
- 12.10 HIERARCHICAL CAUSAL INFERENCE MODEL VERSUS HUMAN DATA
- 12.11 INDEPENDENCE OF PRIORS AND LIKELIHOODS
- 12.12 CONCLUSIONS
- REFERENCES
- 13. Characterization of Multisensory Integration with fMRI: Experimental Design, Statistical Analysis, and InterpretationUta Noppeney.
- 14. Modeling Multisensory Processes in Saccadic Responses: Time-Window-of-Integration ModelAdele Diederich and Hans Colonius.
- 11. Spatial and Temporal Features of Multisensory Processes: Bridging Animal and Human Studies
- IV. Development and Plasticity
- 15. The Organization and Plasticity of Multisensory Integration in the MidbrainThomas J. Perrault Jr., Benjamin A. Rowland, and Barry E. Stein.
- 16. Effects of Prolonged Exposure to Audiovisual Stimuli with Fixed Stimulus Onset
Asynchrony on Interaction Dynamics between Primary Auditory and Primary Visual CortexAntje Fillbrandt and Frank W. Ohl.
- 17. Development of Multisensory Temporal PerceptionDavid J. Lewkowicz.
- 17.1 INTRODUCTION
- 17.2 PERCEPTION OF MULTISENSORY TEMPORAL INFORMATION AND ITS COHERENCE
- 17.3 DEVELOPMENTAL EMERGENCE OF MULTISENSORY PERCEPTION: GENERAL PATTERNS AND EFFECTS OF EXPERIENCE
- 17.4 PERCEPTION OF TEMPORAL INFORMATION IN INFANCY
- 17.5 PERCEPTION OF A–V TEMPORAL SYNCHRONY
- 17.6 PERCEPTION OF MULTISENSORY TEMPORAL SEQUENCES IN INFANCY
- 17.7 SPECULATIONS ON NEURAL MECHANISMS UNDERLYING THE DEVELOPMENT OF MULTISENSORY PERCEPTION
- REFERENCES
- 18. Multisensory Integration Develops Late in HumansDavid Burr and Monica Gori.
- 18.1 DEVELOPMENT OF MULTIMODAL PERCEPTION IN INFANCY AND CHILDHOOD
- 18.2 NEUROPHYSIOLOGICAL EVIDENCE FOR DEVELOPMENT OF MULTIMODAL INTEGRATION
- 18.3 DEVELOPMENT OF CUE INTEGRATION IN SPATIAL NAVIGATION
- 18.4 DEVELOPMENT OF AUDIOVISUAL CUE INTEGRATION
- 18.5 SENSORY EXPERIENCE AND DEPRIVATION INFLUENCE DEVELOPMENT OF MULTISENSORY INTEGRATION
- 18.6 DEVELOPMENT OF VISUO-HAPTIC INTEGRATION
- 18.7 CALIBRATION BY CROSS-MODAL COMPARISON?
- 18.8 HAPTIC DISCRIMINATION IN BLIND AND LOW-VISION CHILDREN: DISRUPTION OF CROSS-SENSORY CALIBRATION?
- 18.9 CONCLUDING REMARKS: EVIDENCE OF LATE MULTISENSORY DEVELOPMENT
- REFERENCES
- 19. Phonetic Recalibration in Audiovisual SpeechJean Vroomen and Martijn Baart.
- 19.1 INTRODUCTION
- 19.2 A SHORT HISTORICAL BACKGROUND ON AUDIOVISUAL SPEECH AFTEREFFECTS
- 19.3 SEMINAL STUDY ON LIP-READ-INDUCED RECALIBRATION
- 19.4 OTHER DIFFERENCES BETWEEN RECALIBRATION AND SELECTIVE SPEECH ADAPTATION
- 19.5 STABILITY OF RECALIBRATION OVER TIME
- 19.6 DEVELOPMENTAL ASPECTS
- 19.7 COMPUTATIONAL MECHANISMS
- 19.8 NEURAL MECHANISMS
- 19.9 CONCLUSION
- REFERENCES
- 20. Multisensory Integration and AgingJennifer L. Mozolic, Christina E. Hugenschmidt, Ann M. Peiffer, and Paul J. Laurienti.
- 15. The Organization and Plasticity of Multisensory Integration in the Midbrain
- V. Clinical Manifestations
- 21. Neurophysiological Mechanisms Underlying Plastic Changes and Rehabilitation following
Sensory Loss in Blindness and Deafness Ella Striem-Amit, Andreja Bubic, and Amir Amedi.
- 22. Visual Abilities in Individuals with Profound Deafness A Critical ReviewFrancesco Pavani and Davide Bottari.
- 23. Peripersonal Space: A Multisensory Interface for Body–Object InteractionsClaudio Brozzoli, Tamar R. Makin, Lucilla Cardinali, Nicholas P. Holmes, and Alessandro Farnè.
- 24. Multisensory Perception and Bodily Self-Consciousness: From Out-of-Body to Inside-Body ExperienceJane E. Aspell, Bigna Lenggenhager, and Olaf Blanke.
- 21. Neurophysiological Mechanisms Underlying Plastic Changes and Rehabilitation following
Sensory Loss in Blindness and Deafness
- VI. Attention and Spatial Representations
- 25. Spatial Constraints in Multisensory AttentionEmiliano Macaluso.
- 26. Cross-Modal Spatial Cueing of Attention Influences Visual PerceptionJohn J. McDonald, Jessica J. Green, Viola S. Störmer, and Steven A. Hillyard.
- 26.1 SPATIAL ATTENTION: MODALITY-SPECIFIC OR SUPRAMODAL?
- 26.2 INVOLUNTARY CROSS-MODAL SPATIAL ATTENTION ENHANCES PERCEPTUAL SENSITIVITY
- 26.3 INVOLUNTARY CROSS-MODAL SPATIAL ATTENTION MODULATES TIME-ORDER PERCEPTION
- 26.4 BEYOND TEMPORAL ORDER: THE SIMULTANEITY JUDGMENT TASK
- 26.5 INVOLUNTARY CROSS-MODAL SPATIAL ATTENTION ALTERS APPEARANCE
- 26.6 POSSIBLE MECHANISMS OF CROSS-MODAL CUE EFFECTS
- 26.7 CONCLUSIONS AND FUTURE DIRECTIONS
- REFERENCES
- 27. The Colavita Visual Dominance EffectCharles Spence, Cesare Parise, and Yi-Chuan Chen.
- 27.1 INTRODUCTION
- 27.2 BASIC FINDINGS ON COLAVITA VISUAL DOMINANCE EFFECT
- 27.3 INTERIM SUMMARY
- 27.4 PRIOR ENTRY AND COLAVITA VISUAL DOMINANCE EFFECT
- 27.5 EXPLAINING THE COLAVITA VISUAL DOMINANCE EFFECT
- 27.6 BIASED (OR INTEGRATED) COMPETITION AND COLAVITA VISUAL DOMINANCE EFFECT
- 27.7 CONCLUSIONS AND QUESTIONS FOR FUTURE RESEARCH
- REFERENCES
- 28. The Body in a Multisensory WorldTobias Heed and Brigitte Röder.
- 25. Spatial Constraints in Multisensory Attention
- VII. Naturalistic Multisensory Processes Motion Signals
- 29. Multisensory Interactions during Motion Perception: From Basic Principles to Media ApplicationsSalvador Soto-Faraco and Aleksander Väljamäe.
- 30. Multimodal Integration during Self-Motion in Virtual RealityJennifer L. Campos and Heinrich H. Bülthoff.
- 30.1 INTRODUCTION
- 30.2 SIMULATION TOOLS AND TECHNIQUES
- 30.3 INFLUENCE OF VISUAL, PROPRIOCEPTIVE, AND VESTIBULAR INFORMATION ON SELF-MOTION PERCEPTION
- 30.4 ADVANTAGES AND DISADVANTAGES OF USING SIMULATION TECHNOLOGY TO STUDY MULTISENSORY SELF-MOTION PERCEPTION
- 30.5 MULTISENSORY SELF-MOTION PERCEPTION: AN APPLIED PERSPECTIVE
- 30.6 SUMMARY
- REFERENCES
- 31. Visual–Vestibular Integration for Self-Motion PerceptionGregory C. DeAngelis and Dora E. Angelaki.
- 31.1 THE PROBLEM OF SELF-MOTION PERCEPTION AND THE UTILITY OF VISUAL–VESTIBULAR INTEGRATION
- 31.2 POTENTIAL NEURAL SUBSTRATES FOR VISUAL–VESTIBULAR INTEGRATION
- 31.3 HEADING TUNING AND SPATIAL REFERENCE FRAMES IN AREA MSTD
- 31.4 THE NEURONAL COMBINATION RULE AND ITS DEPENDENCE ON CUE RELIABILITY
- 31.5 LINKING NEURONAL AND PERCEPTUAL CORRELATES OF MULTISENSORY INTEGRATION
- 31.6 CONCLUSION
- REFERENCES
- 29. Multisensory Interactions during Motion Perception: From Basic Principles to Media Applications
- VIII. Naturalistic Multisensory Processes: Communication Signals
- 32. Unity of the Senses for Primate Vocal CommunicationAsif A. Ghazanfar.
- 32.1 INTRODUCTION
- 32.2 MULTISENSORY COMMUNICATION IS THE DEFAULT MODE OF COMMUNICATION
- 32.3 MONKEYS LINK FACIAL EXPRESSIONS TO VOCAL EXPRESSIONS
- 32.4 DYNAMIC FACES MODULATE VOICE PROCESSING IN AUDITORY CORTEX
- 32.5 AUDITORY CORTICAL INTERACTIONS WITH SUPERIOR TEMPORAL SULCUS MEDIATES FACE/VOICE INTEGRATION
- 32.6 VIEWING VOCALIZING CONSPECIFICS
- 32.7 SOMATOSENSORY FEEDBACK DURING VOCAL COMMUNICATION
- 32.8 EMERGENCE OF MULTISENSORY SYSTEMS FOR COMMUNICATION
- 32.9 CONCLUSIONS
- REFERENCES
- 33. Convergence of Auditory, Visual, and Somatosensory Information in Ventral Prefrontal
CortexLizabeth M. Romanski.
- 34. A Multisensory Perspective on Human Auditory CommunicationKatharina von Kriegstein.
- 32. Unity of the Senses for Primate Vocal Communication
- IX. Naturalistic Multisensory Processes Flavor
- 35. MULTIMODAL CHEMOSENSORY INTERACTIONS AND PERCEPTION OF FLAVORJohn Prescott.
- 35.1 INTRODUCTION
- 35.2 CHEMOSENSORY INTERACTIONS AND INTEGRATION
- 35.3 ASSOCIATIVE LEARNING AND INTEGRATION
- 35.4 CROSS-MODAL CHEMOSENSORY BINDING
- 35.5 ATTENTIONAL PROCESSES IN BINDING
- 35.6 ANALYSIS AND SYNTHESIS IN PERCEPTION OF FLAVOR
- 35.7 INVESTIGATING COGNITIVE PROCESSES IN FLAVOR PERCEPTION
- 35.8 HEDONIC IMPLICATIONS OF CHEMOSENSORY INTEGRATION
- REFERENCES
- 36. A Proposed Model of a Flavor ModalityDana M. Small and Barry G. Green.
- 37. Assessing the Role of Visual and Auditory Cues in Multisensory Perception of
FlavorMassimiliano Zampini and Charles Spence.
- 35. MULTIMODAL CHEMOSENSORY INTERACTIONS AND PERCEPTION OF FLAVOR
- NLM CatalogRelated NLM Catalog Entries
- Review In Vivo Observations of Rapid Scattered Light Changes Associated with Neurophysiological Activity.[In Vivo Optical Imaging of Bra...]Review In Vivo Observations of Rapid Scattered Light Changes Associated with Neurophysiological Activity.Rector DM, Yao X, Harper RM, George JS. In Vivo Optical Imaging of Brain Function. 2009
- Multisensory processing of naturalistic objects in motion: a high-density electrical mapping and source estimation study.[Neuroimage. 2007]Multisensory processing of naturalistic objects in motion: a high-density electrical mapping and source estimation study.Senkowski D, Saint-Amour D, Kelly SP, Foxe JJ. Neuroimage. 2007 Jul 1; 36(3):877-88. Epub 2007 Mar 12.
- Proceedings of the Second Workshop on Theory meets Industry (Erwin-Schrödinger-Institute (ESI), Vienna, Austria, 12-14 June 2007).[J Phys Condens Matter. 2008]Proceedings of the Second Workshop on Theory meets Industry (Erwin-Schrödinger-Institute (ESI), Vienna, Austria, 12-14 June 2007).Hafner J. J Phys Condens Matter. 2008 Feb 13; 20(6):060301. Epub 2008 Jan 24.
- How the brain controls decision making in a multisensory world.[Philos Trans R Soc Lond B Biol...]How the brain controls decision making in a multisensory world.Fetsch CR, Noppeney U. Philos Trans R Soc Lond B Biol Sci. 2023 Sep 25; 378(1886):20220332. Epub 2023 Aug 7.
- Review Multisensory Integration and Aging.[The Neural Bases of Multisenso...]Review Multisensory Integration and Aging.Mozolic JL, Hugenschmidt CE, Peiffer AM, Laurienti PJ. The Neural Bases of Multisensory Processes. 2012
- The Neural Bases of Multisensory ProcessesThe Neural Bases of Multisensory Processes
Your browsing activity is empty.
Activity recording is turned off.
See more...