Skip Navigation



Cerebral Cortex Advance Access published online on February 16, 2005
Cerebral Cortex, doi:10.1093/cercor/bhi052
This Article
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
15/11/1750    most recent
bhi052v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Saito, D. N.
Right arrow Articles by Sadato, N.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Saito, D. N.
Right arrow Articles by Sadato, N.
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

© The Author 2005. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oupjournals.org

Article

Cross-modal Binding and Activated Attentional Networks during Audio-visual Speech Integration: a Functional MRI Study

Daisuke N. Saito 1, Kumiko Yoshimura 1, Takanori Kochiyama 2, Tomohisa Okada 1, Manabu Honda 1, and Norihiro Sadato 3*

1 National Institute for Physiological Sciences, Okazaki, Japan
2 Faculty of Human Studies, Kyoto University, Kyoto, Japan
3 National Institute for Physiological Sciences, Okazaki, Japan; JST (Japan Science and Technology Corporation)/RISTEX (Research Institute of Science and Technology for Society), Kawaguchi, Japan

* To whom correspondence should be addressed.
Norihiro Sadato, E-mail: sadato{at}nips.ac.jp


  Abstract

We evaluated the neural substrates of cross-modal binding and divided attention during audio-visual speech integration using functional magnetic resonance imaging. The subjects (n = 17) were exposed to phonemically concordant or discordant auditory and visual speech stimuli. Three different matching tasks were performed: auditory-auditory (AA), visual-visual (VV) and auditory-visual (AV). Subjects were asked whether the prompted pair were congruent or not. We defined the neural substrates for the within-modal matching tasks by VV-AA and AA-VV. We defined the cross-modal area as the intersection of the loci defined by AV-AA and AV-VV. The auditory task activated the bilateral anterior superior temporal gyrus and superior temporal sulcus, the left planum temporale and left lingual gyrus. The visual task activated the bilateral middle and inferior frontal gyrus, right occipito-temporal junction, intraparietal sulcus and left cerebellum. The bilateral dorsal premotor cortex, posterior parietal cortex (including the bilateral superior parietal lobule and the left intraparietal sulcus) and right cerebellum showed more prominent activation during AV compared with AA and VV. Within these areas, the posterior parietal cortex showed more activation during concordant than discordant stimuli, and hence was related to cross-modal binding. Our results indicate a close relationship between cross-modal attentional control and cross-modal binding during speech reading.

Keywords: cross-modal matching; human voice; integration; intraparietal sulcus; visual.
Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
 Cereb CortexHome page
U. Noppeney, O. Josephs, J. Hocking, C. J. Price, and K. J. Friston
The Effect of Prior Visual Information on Recognition of Speech and Sounds
Cereb Cortex, March 1, 2008; 18(3): 598 - 609.
[Abstract] [Full Text] [PDF]


Disclaimer: Please note that abstracts for content published before 1996 were created through digital scanning and may therefore not exactly replicate the text of the original print issues. All efforts have been made to ensure accuracy, but the Publisher will not be held responsible for any remaining inaccuracies. If you require any further clarification, please contact our Customer Services Department.