Cerebral Cortex Advance Access originally published online on May 17, 2006
Cerebral Cortex 2007 17(3):679-690; doi:10.1093/cercor/bhk016
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Selective Attention and Audiovisual Integration: Is Attending to Both Modalities a Prerequisite for Early Integration?
1 Center for Cognitive Neuroscience, Duke University, Durham, NC, USA, 2 Department of Psychiatry, Duke University, Durham, NC, USA, 3 Department of Cognitive Psychology, Vrije Universiteit, Amsterdam, The Netherlands
Address correspondence to Durk Talsma, Department of Cognitive Psychology, Vrije Universiteit, Van den Boechorststraat 1, 1081 BT Amsterdam, The Netherlands. Email: d.talsma{at}psy.vu.nl.
Interactions between multisensory integration and attention were studied using a combined audiovisual streaming design and a rapid serial visual presentation paradigm. Event-related potentials (ERPs) following audiovisual objects (AV) were compared with the sum of the ERPs following auditory (A) and visual objects (V). Integration processes were expressed as the difference between these AV and (A + V) responses and were studied while attention was directed to one or both modalities or directed elsewhere. Results show that multisensory integration effects depend on the multisensory objects being fully attended—that is, when both the visual and auditory senses were attended. In this condition, a superadditive audiovisual integration effect was observed on the P50 component. When unattended, this effect was reversed; the P50 components of multisensory ERPs were smaller than the unisensory sum. Additionally, we found an enhanced late frontal negativity when subjects attended the visual component of a multisensory object. This effect, bearing a strong resemblance to the auditory processing negativity, appeared to reflect late attention-related processing that had spread to encompass the auditory component of the multisensory object. In conclusion, our results shed new light on how the brain processes multisensory auditory and visual information, including how attention modulates multisensory integration processes.
Key Words: auditory • binding • electrophysiology • multisensory • visual
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  I. C. Fiebelkorn, J. J. Foxe, and S. Molholm Dual Mechanisms for the Cross-Sensory Spread of Attention: How Much Do Learned Associations Matter? Cereb Cortex, April 24, 2009; (2009) bhp083v1. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Hocking and C. J. Price The Role of the Posterior Superior Temporal Sulcus in Audiovisual Processing Cereb Cortex, October 1, 2008; 18(10): 2439 - 2449. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G. F. Alpert, G. Hein, N. Tsai, M. J. Naumer, and R. T. Knight Temporal Characteristics of Audiovisual Information Processing J. Neurosci., May 14, 2008; 28(20): 5344 - 5349. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Mishra, A. Martinez, T. J. Sejnowski, and S. A. Hillyard Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion J. Neurosci., April 11, 2007; 27(15): 4120 - 4131. [Abstract] [Full Text] [PDF]
|
|