Skip Navigation

This Article
Right arrow Full Text Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (48)
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Molholm, S.
Right arrow Articles by Foxe, J. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Molholm, S.
Right arrow Articles by Foxe, J. J.
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

Cerebral Cortex April 2004; 14:452-465
© Oxford University Press 2004

Article

Multisensory Visual–Auditory Object Recognition in Humans: a High-density Electrical Mapping Study

Sophie Molholm1,2, Walter Ritter1,2, Daniel C. Javitt1,3 and John J. Foxe1,2,4,5

1 Cognitive Neurophysiology Laboratory, Program in Cognitive Neuroscience and Schizophrenia, Nathan S. Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA, 2 Department of Psychology, City College of the City University of New York, New York, NY 10031, USA, 3 Department of Psychiatry, New York University School of Medicine, 550 First Avenue, New York, NY 10016, USA, 4 Department of Psychiatry and Behavioral Science, The Albert Einstein College of Medicine, Bronx, NY 10461, USA, 5 Department of Neuroscience, The Albert Einstein College of Medicine, Bronx, NY 10461, USA

Multisensory object-recognition processes were investigated by examining the combined influence of visual and auditory inputs upon object identification — in this case, pictures and vocalizations of animals. Behaviorally, subjects were significantly faster and more accurate at identifying targets when the picture and vocalization were matched (i.e. from the same animal), than when the target was represented in only one sensory modality. This behavioral enhancement was accompanied by a modulation of the evoked potential in the latency range and general topographic region of the visual evoked N1 component, which is associated with early feature processing in the ventral visual stream. High-density topographic mapping and dipole modeling of this multisensory effect were consistent with generators in lateral occipito-temporal cortices, suggesting that auditory inputs were modulating processing in regions of the lateral occipital cortices. Both the timing and scalp topography of this modulation suggests that there are multisensory effects during what is considered to be a relatively early stage of visual object-recognition processes, and that this modulation occurs in regions of the visual system that have traditionally been held to be unisensory processing areas. Multisensory inputs also modulated the visual ‘selection-negativity’, an attention dependent component of the evoked potential this is usually evoked when subjects selectively attend to a particular feature of a visual stimulus.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
 Psychon Bull RevHome page
L. IORDANESCU, E. GUZMAN-MARTINEZ, M. GRABOWECKY, and S. SUZUKI
Characteristic sounds facilitate visual search
Psychon Bull Rev, June 1, 2008; 15(3): 548 - 554.
[Abstract] [PDF]

Home page
 Cereb CortexHome page
M. Plaza, P. Gatignol, H. Cohen, B. Berger, and H. Duffau
A Discrete Area within the Left Dorsolateral Prefrontal Cortex Involved in Visual-Verbal Incongruence Judgment
Cereb Cortex, June 1, 2008; 18(6): 1253 - 1259.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
G. F. Alpert, G. Hein, N. Tsai, M. J. Naumer, and R. T. Knight
Temporal Characteristics of Audiovisual Information Processing
J. Neurosci., May 14, 2008; 28(20): 5344 - 5349.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
U. Noppeney, O. Josephs, J. Hocking, C. J. Price, and K. J. Friston
The Effect of Prior Visual Information on Recognition of Speech and Sounds
Cereb Cortex, March 1, 2008; 18(3): 598 - 609.
[Abstract] [Full Text] [PDF]

Home page
 J. Cogn. Neurosci.Home page
J. J. Stekelenburg and J. Vroomen
Neural correlates of multisensory integration of ecologically valid audiovisual events.
J. Cogn. Neurosci., December 1, 2007; 19(12): 1964 - 1973.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
T. Noesselt, J. W. Rieger, M. A. Schoenfeld, M. Kanowski, H. Hinrichs, H.-J. Heinze, and J. Driver
Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices
J. Neurosci., October 17, 2007; 27(42): 11431 - 11441.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
J. K. Bizley, F. R. Nodal, V. M. Bajo, I. Nelken, and A. J. King
Physiological and Anatomical Evidence for Multisensory Interactions in Auditory Cortex
Cereb Cortex, September 1, 2007; 17(9): 2172 - 2189.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
C. Ramos-Estebanez, L. B. Merabet, K. Machii, F. Fregni, G. Thut, T. A. Wagner, V. Romei, A. Amedi, and A. Pascual-Leone
Visual Phosphene Perception Modulated by Subthreshold Crossmodal Sensory Stimulation
J. Neurosci., April 11, 2007; 27(15): 4178 - 4181.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
S. Yuval-Greenberg and L. Y. Deouell
What You See Is Not (Always) What You Hear: Induced Gamma Band Responses Reflect Cross-Modal Interactions in Familiar Object Recognition
J. Neurosci., January 31, 2007; 27(5): 1090 - 1096.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
D. Senkowski, S. Molholm, M. Gomez-Ramirez, and J. J. Foxe
Oscillatory Beta Activity Predicts Response Speed during a Multisensory Audiovisual Reaction Time Task: A High-Density Electrical Mapping Study
Cereb Cortex, November 1, 2006; 16(11): 1556 - 1565.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
S. Molholm, P. Sehatpour, A. D. Mehta, M. Shpaner, M. Gomez-Ramirez, S. Ortigue, J. P. Dyke, T. H. Schwartz, and J. J. Foxe
Audio-Visual Multisensory Integration in Superior Parietal Lobule Revealed by Human Intracranial Recordings
J Neurophysiol, August 1, 2006; 96(2): 721 - 729.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
M. M. Murray, C. Camen, S. L. Gonzalez Andino, P. Bovet, and S. Clarke
Rapid Brain Discrimination of Sounds of Objects
J. Neurosci., January 25, 2006; 26(4): 1293 - 1302.
[Abstract] [Full Text] [PDF]

Home page
 J. Cogn. Neurosci.Home page
U. Maurer, S. Brem, K. Bucher, and D. Brandeis
Emerging Neurophysiological Specialization for Letter Strings
J. Cogn. Neurosci., October 1, 2005; 17(10): 1532.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
J. A. Johnson and R. J. Zatorre
Attention to Simultaneous Unrelated Auditory and Visual Events: Behavioral and Neural Correlates
Cereb Cortex, October 1, 2005; 15(10): 1609 - 1620.
[Abstract] [Full Text] [PDF]

Home page
 J. Cogn. Neurosci.Home page
D. Tranel, T. J. Grabowski, J. Lyon, and H. Damasio
Naming the Same Entities from Visual or from Auditory Stimulation Engages Similar Regions of Left Inferotemporal Cortices
J. Cogn. Neurosci., August 1, 2005; 17(8): 1293 - 1305.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
M. M. Murray, S. Molholm, C. M. Michel, D. J. Heslenfeld, W. Ritter, D. C. Javitt, C. E. Schroeder, and J. J. Foxe
Grabbing Your Ear: Rapid Auditory-Somatosensory Multisensory Interactions in Low-level Sensory Cortices Are Not Constrained by Stimulus Alignment
Cereb Cortex, July 1, 2005; 15(7): 963 - 974.
[Abstract] [Full Text] [PDF]


Disclaimer:
Please note that abstracts for content published before 1996 were created through digital scanning and may therefore not exactly replicate the text of the original print issues. All efforts have been made to ensure accuracy, but the Publisher will not be held responsible for any remaining inaccuracies. If you require any further clarification, please contact our Customer Services Department.