Cerebral Cortex Advance Access originally published online on February 16, 2005
Cerebral Cortex 2005 15(11):1750-1760; doi:10.1093/cercor/bhi052
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Cross-modal Binding and Activated Attentional Networks during Audio-visual Speech Integration: a Functional MRI Study
1 National Institute for Physiological Sciences, Okazaki, Japan, 2 JST (Japan Science and Technology Corporation)/RISTEX (Research Institute of Science and Technology for Society), Kawaguchi, Japan and 3 Faculty of Human Studies, Kyoto University, Kyoto, Japan
Address correspondence to Norihiro Sadato, Section of Cerebral Integration, Department of Cerebral Research, National Institute for Physiological Sciences, Myodaiji, Okazaki, Aichi, 444-8585, Japan. Email: sadato{at}nips.ac.jp.
We evaluated the neural substrates of cross-modal binding and divided attention during audio-visual speech integration using functional magnetic resonance imaging. The subjects (n = 17) were exposed to phonemically concordant or discordant auditory and visual speech stimuli. Three different matching tasks were performed: auditory–auditory (AA), visual–visual (VV) and auditory–visual (AV). Subjects were asked whether the prompted pair were congruent or not. We defined the neural substrates for the within-modal matching tasks by VV–AA and AA–VV. We defined the cross-modal area as the intersection of the loci defined by AV–AA and AV–VV. The auditory task activated the bilateral anterior superior temporal gyrus and superior temporal sulcus, the left planum temporale and left lingual gyrus. The visual task activated the bilateral middle and inferior frontal gyrus, right occipito-temporal junction, intraparietal sulcus and left cerebellum. The bilateral dorsal premotor cortex, posterior parietal cortex (including the bilateral superior parietal lobule and the left intraparietal sulcus) and right cerebellum showed more prominent activation during AV compared with AA and VV. Within these areas, the posterior parietal cortex showed more activation during concordant than discordant stimuli, and hence was related to cross-modal binding. Our results indicate a close relationship between cross-modal attentional control and cross-modal binding during speech reading.
Key Words: cross-modal matching • human voice • integration • intraparietal sulcus • visual
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  J. Tang, J. Ward, and B. Butterworth Number Forms in the Brain J. Cogn. Neurosci., September 1, 2008; 20(9): 1547 - 1556. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 U. Noppeney, O. Josephs, J. Hocking, C. J. Price, and K. J. Friston The Effect of Prior Visual Information on Recognition of Speech and Sounds Cereb Cortex, March 1, 2008; 18(3): 598 - 609. [Abstract] [Full Text] [PDF]
|
|