Cerebral Cortex Advance Access originally published online on June 2, 2006
Cerebral Cortex 2007 17(4):962-974; doi:10.1093/cercor/bhl007
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
The Effect of Temporal Asynchrony on the Multisensory Integration of Letters and Speech Sounds
1 Department of Cognitive Neuroscience, University of Maastricht, 6200 MD Maastricht, The Netherlands, 2 F.C. Donders Centre for Cognitive Neuroimaging, Radboud University Nijmegen, 6500 HB Nijmegen, The Netherlands
Address correspondence to Nienke M. van Atteveldt, Department of Cognitive Neuroscience, University of Maastricht, P.O. Box 616, 6200 MD Maastricht, The Netherlands. Email: N.vanAtteveldt{at}psychology.unimaas.nl.
Temporal proximity is a critical determinant for cross-modal integration by multisensory neurons. Information content may serve as an additional binding factor for more complex or less natural multisensory information. Letters and speech sounds, which form the basis of literacy acquisition, are not naturally related but associated through explicit learning. We investigated the relative importance of temporal proximity and information content on the integration of letters and speech sounds by manipulating both factors within the same functional magnetic resonance imaging (fMRI) design. The results reveal significant interactions between temporal proximity and content congruency in anterior and posterior auditory association cortex, indicating that temporal synchrony is critical for the integration of letters and speech sounds. The temporal profiles for multisensory integration in the auditory association cortex resemble those demonstrated for single multisensory neurons in different brain structures and animal species. This similarity suggests that basic neural integration rules apply to the binding of multisensory information that is not naturally related but overlearned during literacy acquisition. Furthermore, the present study shows the suitability of fMRI to study temporal aspects of multisensory neural processing.
Key Words: audiovisual auditory cortex fMRI STS temporal proximity
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
G. F. Alpert, G. Hein, N. Tsai, M. J. Naumer, and R. T. Knight Temporal Characteristics of Audiovisual Information Processing J. Neurosci., May 14, 2008; 28(20): 5344 - 5349. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Hocking and C. J. Price The Role of the Posterior Superior Temporal Sulcus in Audiovisual Processing Cereb Cortex, February 14, 2008; (2008) bhn007v1. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Hein, O. Doehrmann, N. G. Muller, J. Kaiser, L. Muckli, and M. J. Naumer Object Familiarity and Semantic Congruency Modulate Responses in Cortical Audiovisual Integration Areas J. Neurosci., July 25, 2007; 27(30): 7881 - 7887. [Abstract] [Full Text] [PDF] |
||||

