Cerebral Cortex, Vol. 13, No. 10, 1034-1043,
October 2003
© 2003 Oxford University Press
Polysensory Interactions along Lateral Temporal Regions Evoked by Audiovisual Speech
1 Brain Imaging and Analysis Center, Duke University Medical Center, , 2 Neurodevelopmental Disorders Research Center, Department of Psychiatry, University of North Carolina at Chapel Hill School of Medicine, Chapel Hill, NC, , 3 Department of Neurology, Yale University School of Medicine, New Haven, CT and , 4 Department of Veterans Affairs Medical Center, Durham, NC, USA
Many socially significant biological stimuli are polymodal, and information processing is enhanced for polymodal over unimodal stimuli. The human superior temporal sulcus (STS) region has been implicated in processing socially relevant stimuli — particularly those derived from biological motion such as mouth movements. Single unit studies in monkeys have demonstrated that regions of STS are polysensory — responding to visual, auditory and somato-sensory stimuli, and human neuroimaging studies have shown that lip-reading activates auditory regions of the lateral temporal lobe. We evaluated whether concurrent speech sounds and mouth movements were more potent activators of STS than either speech sounds or mouth movements alone. In an event-related fMRI study, subjects observed an animated character that produced audiovisual speech and the audio and visual components of speech alone. Strong activation of the STS region was evoked in all three conditions, with greatest levels of activity elicited by audiovisual speech. Subsets of activated voxels within the STS region demonstrated overadditivity (audiovisual > audio + visual) and underadditivity (audiovisual < audio + visual). These results confirm the polysensory nature of STS region and demonstrate for the first time that polymodal interactions may both potentiate and inhibit activation.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  P. Knoeferle, B. Habets, M. W. Crocker, and T. F. Munte Visual Scenes Trigger Immediate Syntactic Reanalysis: Evidence from ERPs during Situated Spoken Comprehension Cereb Cortex, April 1, 2008; 18(4): 789 - 795. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
U. Noppeney, O. Josephs, J. Hocking, C. J. Price, and K. J. Friston The Effect of Prior Visual Information on Recognition of Speech and Sounds Cereb Cortex, March 1, 2008; 18(3): 598 - 609. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Hocking and C. J. Price The Role of the Posterior Superior Temporal Sulcus in Audiovisual Processing Cereb Cortex, February 14, 2008; (2008) bhn007v1. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
E. Eldar, O. Ganor, R. Admon, A. Bleich, and T. Hendler Feeling the Real World: Limbic Response to Music Depends on Related Content Cereb Cortex, December 1, 2007; 17(12): 2828 - 2840. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 Y. Liu, C. Yu, M. Liang, J. Li, L. Tian, Y. Zhou, W. Qin, K. Li, and T. Jiang Whole brain functional connectivity in the early blind Brain, August 1, 2007; 130(8): 2085 - 2096. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. T. Wang, S. S. Lee, M. Sigman, and M. Dapretto Reading Affect in the Face and Voice: Neural Correlates of Interpreting Communicative Intent in Children and Adolescents With Autism Spectrum Disorders Arch Gen Psychiatry, June 1, 2007; 64(6): 698 - 708. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H.-J. Lee, A.-L. Giraud, E. Kang, S.-H. Oh, H. Kang, C.-S. Kim, and D. S. Lee Cortical Activity at Rest Predicts Cochlear Implantation Outcome Cereb Cortex, April 1, 2007; 17(4): 909 - 917. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
N. M. van Atteveldt, E. Formisano, L. Blomert, and R. Goebel The Effect of Temporal Asynchrony on the Multisensory Integration of Letters and Speech Sounds Cereb Cortex, April 1, 2007; 17(4): 962 - 974. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 N. Kuroki, M. E. Shenton, D. F. Salisbury, Y. Hirayasu, T. Onitsuka, H. Ersner, D. Yurgelun-Todd, R. Kikinis, F. A. Jolesz, and R. W. McCarley Middle and Inferior Temporal Gyrus Gray Matter Volume Abnormalities in First-Episode Schizophrenia: An MRI Study Am J Psychiatry, December 1, 2006; 163(12): 2103 - 2110. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Mather, K. J. Mitchell, C. L. Raye, D. L. Novak, E. J. Greene, and M. K. Johnson Emotional arousal can impair feature binding in working memory. J. Cogn. Neurosci., April 1, 2006; 18(4): 614 - 625. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. A. Pelphrey, J. P. Morris, C. R. Michelich, T. Allison, and G. McCarthy Functional Anatomy of Biological Motion Perception in Posterior Temporal Cortex: An fMRI Study of Eye, Mouth and Hand Movements Cereb Cortex, December 1, 2005; 15(12): 1866 - 1876. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. A. Ghazanfar, J. X. Maier, K. L. Hoffman, and N. K. Logothetis Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex J. Neurosci., May 18, 2005; 25(20): 5004 - 5012. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 V. van Wassenhove, K. W. Grant, and D. Poeppel Visual speech speeds up the neural processing of auditory speech PNAS, January 25, 2005; 102(4): 1181 - 1186. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. A. Pelphrey, J. P. Morris, and G. McCarthy Grasping the Intentions of Others: The Perceived Intentionality of an Action Influences Activity in the Superior Temporal Sulcus during Social Perception J. Cogn. Neurosci., December 1, 2004; 16(10): 1706 - 1716. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. J. Laurienti Deactivations, Global Signal, and the Default Mode of Brain Function J. Cogn. Neurosci., November 1, 2004; 16(9): 1481 - 1483. [Full Text] [PDF]
|
|