Skip Navigation

This Article
Right arrow Full Text Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (83)
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Wright, T. M.
Right arrow Articles by McCarthy, G.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Wright, T. M.
Right arrow Articles by McCarthy, G.
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

Cerebral Cortex, Vol. 13, No. 10, 1034-1043, October 2003
© 2003 Oxford University Press

Polysensory Interactions along Lateral Temporal Regions Evoked by Audiovisual Speech

Tarra M. Wright1, Kevin A. Pelphrey1,2, Truett Allison3, Martin J. McKeown1 and Gregory McCarthy1,4

1 Brain Imaging and Analysis Center, Duke University Medical Center, , 2 Neurodevelopmental Disorders Research Center, Department of Psychiatry, University of North Carolina at Chapel Hill School of Medicine, Chapel Hill, NC, , 3 Department of Neurology, Yale University School of Medicine, New Haven, CT and , 4 Department of Veterans Affairs Medical Center, Durham, NC, USA

Many socially significant biological stimuli are polymodal, and information processing is enhanced for polymodal over unimodal stimuli. The human superior temporal sulcus (STS) region has been implicated in processing socially relevant stimuli — particularly those derived from biological motion such as mouth movements. Single unit studies in monkeys have demonstrated that regions of STS are polysensory — responding to visual, auditory and somato-sensory stimuli, and human neuroimaging studies have shown that lip-reading activates auditory regions of the lateral temporal lobe. We evaluated whether concurrent speech sounds and mouth movements were more potent activators of STS than either speech sounds or mouth movements alone. In an event-related fMRI study, subjects observed an animated character that produced audiovisual speech and the audio and visual components of speech alone. Strong activation of the STS region was evoked in all three conditions, with greatest levels of activity elicited by audiovisual speech. Subsets of activated voxels within the STS region demonstrated overadditivity (audiovisual > audio + visual) and underadditivity (audiovisual < audio + visual). These results confirm the polysensory nature of STS region and demonstrate for the first time that polymodal interactions may both potentiate and inhibit activation.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
 Cereb CortexHome page
R.-i. Hashimoto, K. Lee, A. Preus, R. W. McCarley, and C. G. Wible
An fMRI Study of Functional Abnormalities in the Verbal Working Memory System and the Relationship to Clinical Symptoms in Chronic Schizophrenia
Cereb Cortex, January 1, 2010; 20(1): 46 - 60.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
S. Werner and U. Noppeney
Superadditive Responses in Superior Temporal Sulcus Predict Audiovisual Benefits in Object Categorization
Cereb Cortex, November 18, 2009; (2009) bhp248v1.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
A. Falchier, C. E. Schroeder, T. A. Hackett, P. Lakatos, S. Nascimento-Silva, I. Ulbert, G. Karmos, and J. F. Smiley
Projection from Visual Areas V2 and Prostriata to Caudal Auditory Cortex in the Monkey
Cereb Cortex, October 29, 2009; (2009) bhp213v1.
[Abstract] [Full Text] [PDF]

Home page
 BrainHome page
M.-W. Suh, H.-J. Lee, J. S. Kim, C. K. Chung, and S.-H. Oh
Speech experience shapes the speechreading network and subsequent deafness facilitates it
Brain, October 1, 2009; 132(10): 2761 - 2771.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
L. A. Renier, I. Anurova, A. G. De Volder, S. Carlson, J. VanMeter, and J. P. Rauschecker
Multisensory Integration of Sounds and Vibrotactile Stimuli in Processing Streams for "What" and "Where"
J. Neurosci., September 2, 2009; 29(35): 10950 - 10960.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
B. R. Buchsbaum and M. D'Esposito
Repetition Suppression and Reactivation in Auditory-Verbal Short-Term Recognition Memory
Cereb Cortex, June 1, 2009; 19(6): 1474 - 1485.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
C. Chandrasekaran and A. A. Ghazanfar
Different Neural Frequency Bands Integrate Faces and Voices Differently in the Superior Temporal Sulcus
J Neurophysiol, February 1, 2009; 101(2): 773 - 788.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
J. Hocking and C. J. Price
The Role of the Posterior Superior Temporal Sulcus in Audiovisual Processing
Cereb Cortex, October 1, 2008; 18(10): 2439 - 2449.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
P. Knoeferle, B. Habets, M. W. Crocker, and T. F. Munte
Visual Scenes Trigger Immediate Syntactic Reanalysis: Evidence from ERPs during Situated Spoken Comprehension
Cereb Cortex, April 1, 2008; 18(4): 789 - 795.
[Abstract] [Full Text] [PDF]

Home page
 Phil Trans R Soc BHome page
R. Campbell
The processing of audio-visual speech: empirical and neural bases
Phil Trans R Soc B, March 12, 2008; 363(1493): 1001 - 1010.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
U. Noppeney, O. Josephs, J. Hocking, C. J. Price, and K. J. Friston
The Effect of Prior Visual Information on Recognition of Speech and Sounds
Cereb Cortex, March 1, 2008; 18(3): 598 - 609.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
E. Eldar, O. Ganor, R. Admon, A. Bleich, and T. Hendler
Feeling the Real World: Limbic Response to Music Depends on Related Content
Cereb Cortex, December 1, 2007; 17(12): 2828 - 2840.
[Abstract] [Full Text] [PDF]

Home page
 BrainHome page
Y. Liu, C. Yu, M. Liang, J. Li, L. Tian, Y. Zhou, W. Qin, K. Li, and T. Jiang
Whole brain functional connectivity in the early blind
Brain, August 1, 2007; 130(8): 2085 - 2096.
[Abstract] [Full Text] [PDF]

Home page
 Arch Gen PsychiatryHome page
A. T. Wang, S. S. Lee, M. Sigman, and M. Dapretto
Reading Affect in the Face and Voice: Neural Correlates of Interpreting Communicative Intent in Children and Adolescents With Autism Spectrum Disorders
Arch Gen Psychiatry, June 1, 2007; 64(6): 698 - 708.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
H.-J. Lee, A.-L. Giraud, E. Kang, S.-H. Oh, H. Kang, C.-S. Kim, and D. S. Lee
Cortical Activity at Rest Predicts Cochlear Implantation Outcome
Cereb Cortex, April 1, 2007; 17(4): 909 - 917.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
N. M. van Atteveldt, E. Formisano, L. Blomert, and R. Goebel
The Effect of Temporal Asynchrony on the Multisensory Integration of Letters and Speech Sounds
Cereb Cortex, April 1, 2007; 17(4): 962 - 974.
[Abstract] [Full Text] [PDF]

Home page
 Am. J. PsychiatryHome page
N. Kuroki, M. E. Shenton, D. F. Salisbury, Y. Hirayasu, T. Onitsuka, H. Ersner, D. Yurgelun-Todd, R. Kikinis, F. A. Jolesz, and R. W. McCarley
Middle and Inferior Temporal Gyrus Gray Matter Volume Abnormalities in First-Episode Schizophrenia: An MRI Study
Am J Psychiatry, December 1, 2006; 163(12): 2103 - 2110.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
K. A. Pelphrey, J. P. Morris, C. R. Michelich, T. Allison, and G. McCarthy
Functional Anatomy of Biological Motion Perception in Posterior Temporal Cortex: An fMRI Study of Eye, Mouth and Hand Movements
Cereb Cortex, December 1, 2005; 15(12): 1866 - 1876.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
A. A. Ghazanfar, J. X. Maier, K. L. Hoffman, and N. K. Logothetis
Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex
J. Neurosci., May 18, 2005; 25(20): 5004 - 5012.
[Abstract] [Full Text] [PDF]

Home page
 Proc. Natl. Acad. Sci. USAHome page
V. van Wassenhove, K. W. Grant, and D. Poeppel
Visual speech speeds up the neural processing of auditory speech
PNAS, January 25, 2005; 102(4): 1181 - 1186.
[Abstract] [Full Text] [PDF]


Disclaimer: Please note that abstracts for content published before 1996 were created through digital scanning and may therefore not exactly replicate the text of the original print issues. All efforts have been made to ensure accuracy, but the Publisher will not be held responsible for any remaining inaccuracies. If you require any further clarification, please contact our Customer Services Department.