Cerebral Cortex Advance Access originally published online on November 10, 2004
Cerebral Cortex 2005 15(7):963-974; doi:10.1093/cercor/bhh197
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Cerebral Cortex V 15 N 7 © Oxford University Press 2004; all rights reserved
Grabbing Your Ear: Rapid Auditory–Somatosensory Multisensory Interactions in Low-level Sensory Cortices Are Not Constrained by Stimulus Alignment
1 The Cognitive Neurophysiology Lab, Nathan S. Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA, 2 Division Autonome de Neuropsychologie and Service Radiodiagnostic et Radiologie Interventionnelle, Centre Hospitalier Universitaire Vaudois, Lausanne, Switzerland, 3 Department of Neurology, University Hospital of Geneva, Geneva, Switzerland, 4 Department of Cognitive Psychology, Free University, Amsterdam, The Netherlands, 5 Department of Neuroscience, Albert Einstein College of Medicine, New York, USA
Address correspondence to John J. Foxe, The Cognitive Neurophysiology Lab, Nathan S. Kline Institute, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA, email: foxe{at}nki.rfmh.org or Micah Murray, Division Autonome de Neuropsychologie and Service Radiodiagnostic et Radiologie Interventionnelle, Centre Hospitalier Universitaire Vaudois, Lausanne, Switzerland, email: micah.murray{at}hospvd.ch.
Multisensory interactions are observed in species from single-cell organisms to humans. Important early work was primarily carried out in the cat superior colliculus and a set of critical parameters for their occurrence were defined. Primary among these were temporal synchrony and spatial alignment of bisensory inputs. Here, we assessed whether spatial alignment was also a critical parameter for the temporally earliest multisensory interactions that are observed in lower-level sensory cortices of the human. While multisensory interactions in humans have been shown behaviorally for spatially disparate stimuli (e.g. the ventriloquist effect), it is not clear if such effects are due to early sensory level integration or later perceptual level processing. In the present study, we used psychophysical and electrophysiological indices to show that auditory–somatosensory interactions in humans occur via the same early sensory mechanism both when stimuli are in and out of spatial register. Subjects more rapidly detected multisensory than unisensory events. At just 50 ms post-stimulus, neural responses to the multisensory ‘whole’ were greater than the summed responses from the constituent unisensory ‘parts’. For all spatial configurations, this effect followed from a modulation of the strength of brain responses, rather than the activation of regions specifically responsive to multisensory pairs. Using the local auto-regressive average source estimation, we localized the initial auditory–somatosensory interactions to auditory association areas contralateral to the side of somatosensory stimulation. Thus, multisensory interactions can occur across wide peripersonal spatial separations remarkably early in sensory processing and in cortical regions traditionally considered unisensory.
Key Words: area CM • cross-modal • event-related potential (ERP) • human • LAURA source estimation • redundant signals effect (RSE)
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  C. Kayser, C. I. Petkov, and N. K. Logothetis Visual Modulation of Neurons in Auditory Cortex Cereb Cortex, July 1, 2008; 18(7): 1560 - 1574. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. M. Rodgers, A. M. Benison, A. Klein, and D. S. Barth Auditory, Somatosensory, and Multisensory Insular Cortex in the Rat Cereb Cortex, April 18, 2008; (2008) bhn054v1. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 V. Romei, M. M. Murray, L. B. Merabet, and G. Thut Occipital Transcranial Magnetic Stimulation Has Opposing Effects on Visual and Auditory Stimulus Detection: Implications for Multisensory Interactions J. Neurosci., October 24, 2007; 27(43): 11465 - 11472. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. Noesselt, J. W. Rieger, M. A. Schoenfeld, M. Kanowski, H. Hinrichs, H.-J. Heinze, and J. Driver Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices J. Neurosci., October 17, 2007; 27(42): 11431 - 11441. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 V. M. Ciaramitaro, G. T. Buracas, and G. M. Boynton Spatial and Cross-Modal Attention Alter Responses to Unattended Sensory Information in Early Visual and Auditory Human Cortex J Neurophysiol, October 1, 2007; 98(4): 2399 - 2413. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. K. Bizley, F. R. Nodal, V. M. Bajo, I. Nelken, and A. J. King Physiological and Anatomical Evidence for Multisensory Interactions in Auditory Cortex Cereb Cortex, September 1, 2007; 17(9): 2172 - 2189. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. Martuzzi, M. M. Murray, C. M. Michel, J.-P. Thiran, P. P. Maeder, S. Clarke, and R. A. Meuli Multisensory Interactions within Human Primary Cortices Revealed by BOLD Dynamics Cereb Cortex, July 1, 2007; 17(7): 1672 - 1679. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Mishra, A. Martinez, T. J. Sejnowski, and S. A. Hillyard Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion J. Neurosci., April 11, 2007; 27(15): 4120 - 4131. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. Kayser, C. I. Petkov, M. Augath, and N. K. Logothetis Functional Imaging Reveals Visual Modulation of Specific Fields in Auditory Cortex J. Neurosci., February 21, 2007; 27(8): 1824 - 1835. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. De Santis, S. Clarke, and M. M. Murray Automatic and Intrinsic Auditory "What" and "Where" Processing in Humans Revealed by Electrical Neuroimaging Cereb Cortex, January 1, 2007; 17(1): 9 - 17. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Arzy, G. Thut, C. Mohr, C. M. Michel, and O. Blanke Neural Basis of Embodiment: Distinct Contributions of Temporoparietal Junction and Extrastriate Body Area J. Neurosci., August 2, 2006; 26(31): 8074 - 8081. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. Macaluso Multisensory Processing in Sensory-Specific Cortical Areas Neuroscientist, August 1, 2006; 12(4): 327 - 338. [Abstract] [PDF]
|
|
|
|
|
|
M. M. Murray, C. Camen, S. L. Gonzalez Andino, P. Bovet, and S. Clarke Rapid Brain Discrimination of Sounds of Objects J. Neurosci., January 25, 2006; 26(4): 1293 - 1302. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 W. A. Teder-Salejarvi, F. Di Russo, J. J. McDonald, and S. A. Hillyard Effects of Spatial Congruity on Audio-Visual Multimodal Integration J. Cogn. Neurosci., September 1, 2005; 17(9): 1396 - 1409. [Abstract] [Full Text] [PDF]
|
|