Skip Navigation


Cerebral Cortex Advance Access originally published online on June 8, 2005
Cerebral Cortex 2006 16(3):437-445; doi:10.1093/cercor/bhi123
This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow Supplementary Material
Right arrow All Versions of this Article:
16/3/437    most recent
bhi123v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (34)
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Noppeney, U.
Right arrow Articles by Friston, K. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Noppeney, U.
Right arrow Articles by Friston, K. J.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

© The Author 2005. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oupjournals.org

Two Distinct Neural Mechanisms for Category-selective Responses

Uta Noppeney, Cathy J. Price, Will D. Penny and Karl J. Friston

Wellcome Department of Imaging Neuroscience, University College London, 12 Queen Square, London WC1 N3BG, UK

Address correspondence to U. Noppeney, Wellcome Department of Imaging Neuroscience, University College London, 12 Queen Square, London WC1 N3BG, UK. Email: u.noppeney{at}fil.ion.ucl.ac.uk.


    Abstract
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Supplementary Material
 References
 
The cognitive and neural mechanisms mediating category-selective responses in the human brain remain controversial. Using functional magnetic resonance imaging and effective connectivity analyses (Dynamic Causal Modelling), we investigated animal- and tool-selective responses by manipulating stimulus modality (pictures versus words) and task (implicit versus explicit semantic). We dissociated two distinct mechanisms that engender category selectivity: in the ventral occipito-temporal cortex, tool-selective responses were observed irrespective of task, greater for pictures and mediated by bottom-up effects. In a left temporo-parietal action system, tool-selective responses were observed irrespective of modality, greater for explicit semantic tasks and mediated by top-down modulation from the left prefrontal cortex. These distinct activation and connectivity patterns suggest that the two systems support different cognitive operations, with the ventral occipito-temporal regions engaged in structural processing and the dorsal visuo-motor system in strategic semantic processing. Consistent with current semantic theories, explicit semantic processing of tools might thus rely on reactivating their associated action representations via top-down modulation. In terms of neuronal mechanisms, the category selectivity may be mediated by distinct top-down (task-dependent) and bottom-up (stimulus-dependent) mechanisms.

Key Words: category selectivity • dynamic causal modelling • effective connectivity • functional imaging • semantic memory


    Introduction
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Supplementary Material
 References
 
A central question in cognitive neuroscience is how object concepts are represented and processed in the human brain. Category-selective impairments in patients with focal cortical lesions suggest specialized neuronal systems that are engaged by different semantic categories such as animals and tools (Warrington and Shallice, 1984Go; Gainotti et al., 1995Go; Capitani et al., 2003Go). These category-selective deficits have been found at multiple processing levels, ranging from structural to semantic (Humphreys and Forde, 2001Go). Similarly, functional brain imaging studies have reported category-selective activations in multiple cortical regions. Activations within the fusiform gyrus have been found medially for tools and laterally for animals (Chao et al., 1999Go). In addition, tools have been associated with activations in a visuo-motor action system encompassing a left posterior middle temporal area (lpMT; Martin et al., 1996Go; Damasio et al., 1996Go; Devlin et al., 2002Go; Kellenbach et al., 2002Go), the anterior intraparietal sulcus (AIP; Chao and Martin, 2000Go) and the ventral premotor cortex (Rizzolatti et al., 1996Go; Grafton et al., 1996Go; Grabowski et al., 1998Go). Despite this extensive evidence for category-selective regions, the associated cognitive processes and their neural implementation remain unclear.

The present functional magnetic resonance imaging (fMRI) study addressed two key questions: first, we asked whether category-selective fMRI responses were differentially modulated by stimulus modality (i.e. pictures versus words) and/or task-context. Second, using effective connectivity analyses (Dynamic Causal Modelling, DCM; Friston et al., 2003Go), we investigated the neural mechanisms that mediate context-sensitive, category-selective responses entailed by our first question.

The aim of DCM is to make inferences about the coupling among brain areas within a simple but reasonably realistic neuronal model. DCM is a generalization of the linear convolution model used in conventional analyses of regionally specific effects. However, in a conventional analysis, the experimental effects are expressed through a direct or extrinsic influence of experimental effects on each region. In contrast, DCM tries to explain regional responses in terms of interactions among brain regions and, critically, an effect of experimental manipulations on connections between brain regions.

Subjects were engaged in a one-back task on animals and tools that were presented as pictures, written words or spoken words. The one-back task used either implicit (i.e. stimulus identity) or explicit (i.e. typical action or real-life-size of the stimulus) semantic attributes. This design allowed us to segregate category-selective regions into two classes: in one class, category selectivity was stimulus modality-dependent and observed primarily for pictures. In the other class, it was task-dependent and observed when subjects were engaged in explicit semantic tasks.

Using DCM, we then investigated the neural mechanisms underlying category selectivity in two representative brain regions, one exhibiting modality-dependent, the other one task-dependent tool-selective responses. The model included bottom-up input from early visual areas and top-down influences from left prefrontal areas. This allowed us to address the following three questions: (i) are stimulus modality-dependent tool-selective responses mediated by forward connections from early visual areas that are enabled when tools are presented as pictures? (ii) Are task-dependent tool-selective activations mediated via increased backward influences from left prefrontal regions during explicit semantic tasks? (iii) Can the distinct category-selective activation patterns in the two modality- and task-dependent regions be explained by differential modulation of forward or backward connections?


    Materials and Methods
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Supplementary Material
 References
 
Subjects

Twenty-two healthy right-handed English native speakers (14 males; mean age 25 years; range 19–35 years) gave informed consent to participate in the study. All subjects had normal or corrected to normal vision and no diagnosis of dyslexia. All of them reported good reading abilities. Twenty-one were either currently university students or reported having been educated to degree level. The study was approved of by the joint ethics committee of the Institute of Neurology and University College London Hospital, London, UK.

Experimental Design

The activation conditions conformed to a 2 x 3 x 3 factorial design manipulating the following:

  1. Semantic category: animals or tools.
  2. Stimulus modality: pictures, written words or spoken words. This manipulation allowed us to investigate whether category-effects are elicited by verbal (written or spoken words) and non-verbal (pictures) material. We hypothesized that verbal material would elicit category-effects primarily at the semantic level, while pictures would also induce category-effects at the structural level.
  3. Task: Subjects were engaged in a one back-task and decided whether subsequent stimuli within a block were identical (= implicit semantic task; e.g. sparrow, sparrow), performed a similar action (= explicit action semantic task; e.g. stork, butterfly) or were of similar size in real life (= explicit visual semantic task; e.g. pigeon, rabbit). Irrespective of task, subjects were instructed to view the pictures, read the written words silently and listen to the spoken words. While the identity task elicits only stimulus-driven implicit semantic activations that are not required for task performance (see Price et al., 1996Go), we expected the action and size tasks to evoke additional task-induced, strategic semantic activations necessary for explicit semantic categorization.

Altogether, there were 90 animals and 90 tools that were matched for word frequency and number of letters. Each stimulus was presented once in each stimulus modality and during each task (i.e. three times during the entire experiment), yielding 270 animal and 270 tool events. Approximately 30% of the stimuli were targets. As the implicit task inevitably required successive repetitions of the targets, 16 additional target stimuli were used for the implicit condition to avoid repetition priming confounds. Yes/No responses to all conditions were indicated (as quickly and as accurately as possible) by a two-choice key press. The stimuli (stimulus onset asynchrony = 3.3 s; stimulus duration = 1.2 s) were presented in blocks of five stimuli interleaved with 5.5 s fixation periods. The category and modality factors were manipulated across the activation blocks, the task factor in long periods covering one-third of each session. The order of semantic conditions was counterbalanced within and across subjects.

fMRI Scanning

A 1.5 T Siemens Sonata system was used to acquire both T1 anatomical volume images and T2*-weighted axial echoplanar images with blood oxygenation level-dependent (BOLD) contrast (gradient echo, Cartesian k-space sampling, TE = 50 ms, TR = 2.97 s, 33 slices acquired sequentially in descending direction, matrix 64 x 64, spatial resolution 3 x 3 x 3.4 mm3 voxels, interslice gap 1.4 mm, slice thickness 2.0 mm, tilted from transverse to coronal orientation by –30° to reduce susceptibility artefacts). To avoid Nyquist ghost artefacts a generalized reconstruction algorithm was used for data processing (Josephs et al., 2000Go). There were three sessions, with a total of 340 volume images per session. The first six volumes were discarded to allow for T1 equilibration effects.

Conventional SPM Analysis

The data were analysed with statistical parametric mapping (using SPM2 software from the Wellcome Department of Imaging Neuroscience, London; Friston et al., 1995Go). Scans from each subject were realigned using the first as a reference, spatially normalized into standard space (Talairach and Tournoux, 1988Go), resampled to 3 x 3 x 3 mm3 voxels and spatially smoothed with a Gaussian kernel of 8 mm FWHM. The time series in each voxel were highpass filtered to 1/128 Hz and globally normalized with proportional scaling. The fMRI experiment was modelled in an event related fashion with regressors (i.e. explanatory variables) made by convolving each event-related stimulus function with a canonical haemodynamic response function and its first temporal derivative. Stimulus functions were a series of delta or ‘stick’ functions encoding the occurrence of each trial type. In addition to modelling the 18 conditions in our 2 x 3 x 3 factorial design, the statistical model included instructions, targets during the implicit condition and non-responses. Covariates of no interest included the realignment parameters (to account for motion artefacts). The analysis was performed twice: (i) including all trials and (ii) including only the trials that were equated for reaction times with respect to the main effect of category and the interaction between category and modality/task. This involved excluding (i) tool trials with reaction times that were ≥1.25 SD above the mean and (ii) animal trials with reaction times that were ≥1.25 SD below the mean during the explicit semantic conditions (the excluded trials that accounted for <10% of all trials in any subject were modelled as an extra confounding effect). Condition-specific effects for each subject were estimated according to the general linear model and passed to a second-level or subject-level analysis as contrasts. Here each contrast was the estimated response for each condition. This involved creating 18 contrast images (i.e each of the 18 conditions averaged across the three sessions) for each subject and entering them into a second level analysis of variance (ANOVA). This ANOVA modelled the 18 effects in our 2 x 3 x 3 factorial design. Inferences were made at the second level to allow a random effects analysis and inferences at the population level [Friston et al., 1999Go).

The random effects analysis tested for the main effects of tools relative to animals and animals relative to tools. Pooling over written and spoken words, we tested for the interactions between category and stimulus modality, i.e. tool- or animal-selective responses that were increased or decreased for pictures relative to words. Pooling over action and visual explicit semantic tasks, we tested for the interactions between category and task, i.e. tool- or animal-selective responses that were increased or decreased for explicit relative to implicit tasks.

All effects were inclusively masked with all stimuli > baseline (at P < 0.001, uncorrected). The interactions were further characterized by inclusively masking each contrast with (i) tools > animals or (ii) animals > tools (at P < 0.001, uncorrected). Unless otherwise stated, we only report activations that are significant (P < 0.05) corrected for the entire brain volume.

DCM Analysis

DCM treats the brain as a dynamic input–state–output system. The inputs correspond to conventional stimulus functions encoding experimental manipulations. The state variables are neuronal activities and the outputs are the regional haemodynamic responses measured with fMRI. The idea is to model changes in the states, which cannot be observed directly, using the known inputs and outputs. Critically, changes in the states of one region depend on the states (i.e. activity) of others. This dependency is parameterized by effective connectivity. There are three types of parameters in a DCM: (i) input parameters which describe how much brain regions respond to experimental stimuli; (ii) intrinsic parameters that characterize effective connectivity among regions; and (iii) modulatory parameters that characterize changes in effective connectivity caused by experimental manipulation. This third set of parameters, the modulatory effects, allows us to explain context-sensitive category-selective activations by changes in coupling among brain areas. Importantly, this coupling (effective connectivity) is expressed at the level of neuronal states. DCM employs a forward model, relating neuronal activity to fMRI data, that can be inverted during the model fitting process. Put simply, the forward model is used to predict the outputs using the inputs. The parameters are adjusted (using gradient descent) so that the predicted and observed outputs match. This adjustment corresponds to the model-fitting.

Twenty-two subject-specific DCMs were constructed. The regions (see Table 3) were selected using the maxima from the random effects analysis. The left posterior medial fusiform and anterior inferior parietal (AIP) regions were selected as representative regions for modality- and task-dependent category selectivity respectively. Region-specific time-series (concatenated over three sessions and adjusted for confounds) comprised the first eigenvariate of all voxels within a 4 mm radius centred on each location. The DCM (Fig. 4) included five regions: (i) a left superior temporal area that was activated by spoken words relative to fixation (STG); (ii) a left occipital region that was activated for both written words and pictures and did not show any category selectivity (OCC); (iii) a task-sensitive left prefrontal region (PF); (iv) tool-selective AIP; and (v) the tool-selective left posterior medial fusiform area. Based on our scientific question (see introduction), the tool-selective regions were selected that showed an interaction effect, i.e. we selected a modality-dependent fusiform and a task-dependent AIP tool-selective region. In other words, we used DCM to understand how regionally-specific interactions are mediated by changes in coupling. Visual input (wordswritten and pictures) was connected to OCC, the auditory input (wordsspoken) to STG. The main effect of task entered directly in the left prefrontal area. Tool pictures, tool wordswritten and pictures modulated or enabled the forward connections from OCC to the category-selective regions. These three effects were chosen to cover the main effect of category, stimulus modality and their interaction. Category effects (tools in all modalities) were entered to modulate the backward connection from PF to the category-selective regions.


View this table:
[in this window]
[in a new window]
 
Table 3 Animal-selective activation

 

Figure 4
View larger version (20K):
[in this window]
[in a new window]
 
Figure 4. DCM for left anterior intraparietal (AIP) and left posterior medial fusiform gyrus (FG) responses. Values are the mean (SD) of changes in connection strength (over subjects; at P < 0.001 in bold). These parameters quantify how experimental manipulations change the values of intrinsic connections. In dynamic systems the strength of a coupling can be thought of as a rate constant or the reciprocal of the time constant. Typically regional activity has a time constant in the order of 1–2 s (rate of 1–0.5 s–1). Therefore, a modulatory effect of 0.05 s–1 corresponds to a 5–10% increase in coupling.

 
The subject-specific modulatory effects were entered into t-tests at the group level. This allowed us to summarize the consistent findings from the subject-specific DCMs using classical statistics. First, we tested whether tool pictures relative to tool words increased the strength of forward connections (i.e. we tested for a modulatory effect of the category x modality interaction on forward connections). Second, we tested whether tools increased the backward connections from the left prefrontal to the category-selective regions. As the left prefrontal response is caused primarily by the main effect of task, this effectively tests for a category x task interaction mediated by backward connections. Finally, we tested for differences in modulatory effects between connections to the fusiform and AIP regions using a paired t-test. This allowed us to characterize category-selective effects in terms of a differential enabling of dorsal and ventral pathways.


    Results
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Supplementary Material
 References
 
Behavioural Results

For performance accuracy, a three-way ANOVA with category (tools, animals), stimulus modality (pictures, spoken words, written words) and task (identity, action, real life size) identified a significant main effect of stimulus modality [F(1.7,36.5) = 9.6; P < 0.01] and of task [F(1.8,39) = 247; P < 0.001] after Greenhouse–Geisser correction. Importantly, there was no significant effect of category or the interactions between category and task/modality. For reaction times, the three-way ANOVA identified (i) main effects of category [F(1,21) = 66; P < 0.001], stimulus modality [F(1.5,31) = 597; P < 0.001] and task [F(1.7,35) = 203; P < 0.001] and (ii) significant interactions of category by stimulus modality [F(1.9,41) = 7; P < 0.01] and category by task [F(1.8,38) = 13; P < 0.001] following Greenhouse–Geisser correction. After equating the reaction times with respect to the main effect of category and the interaction between category and modality/task, the three-way ANOVA only identified (i) main effects of stimulus modality [F(1.2,26) = 597; P < 0.001] and task [F(1.7,34) = 203; P < 0.001] following Greenhouse–Geisser correction (see Table 1).


View this table:
[in this window]
[in a new window]
 
Table 1 Behavioral data

 
Conventional SPM Analysis

The SPM analysis was performed in two steps: first, we identified regions that responded selectively to tools or animals (see Fig. 1). Second, we tested for category-selective responses that were significantly modulated by stimulus modality or task-context. Analyses including all trials or only the trials that were equated for reaction times (see Materials and Methods) gave nearly identical results. We report the results of the latter conventional analysis.


Figure 1
View larger version (61K):
[in this window]
[in a new window]
 
Figure 1. Top: main effects of category: tool- and animal-selective activations are rendered on an averaged normalized brain. Height threshold: P < 0.05, corrected. Extent threshold: >1 voxel, including only voxels that were activated for stimulus > fixation at P < 0.001 (uncorrected). Bottom: main effects of category and category x task/modality interactions on coronal and sagittal slices of a structural image created by averaging the subjects' normalized images. Black: tools > animals; mid-gray: animals > tools; dark gray: tools > animals for semantic decision > implicit task; light-gray: (i) tools > animals for pictures > words or (ii) animals > tools for pictures > words. Height threshold: P < 0.001, uncorrected for illustration purposes. Extent threshold: >19 voxels restricted to voxels that showed a significant effect of category selectivity and stimulus > fixation. Please see the supplementary data online for a color version of this figure.

 
Tools evoked increased responses relative to animals, in the left posterior medial and anterior fusiform regions. At a lower significance threshold, we observed increased responses in the right medial fusiform region (coordinates: [27 –42 –21]; z = 4.4; P < 0.001, uncorrected). In addition, tools evoked selective responses in a visuo-motor system encompassing a left posterior middle/inferior temporal area (lpMT), the anterior intraparietal sulcus (AIP) and several left prefrontal regions. Left prefrontal activation was found in the ventral premotor area and along the left inferior frontal sulcus extending into the triangular part of the left inferior frontal gyrus. Critically, tool-selective responses in the occipito-temporal areas showed a significant interaction with stimulus modality and were greater for pictures. For pictures relative to written words only (i.e. excluding spoken words) a left medial fusiform, middle and superior occipital region showed increased tool-selective activations, and the right middle and superior occipital regions showed increased animal-selective activation. This demonstrates that the interaction effect reflects the difference between verbal and non-verbal stimuli. In contrast, responses in lpMT and AIP exhibited a significant interaction with task and were greater for explicit semantic tasks that required retrieval of an associated action or the real life size of the stimulus. The apparent increased activation for animals relative to tools in AIP (see Fig. 2) during the implicit condition was not significant at P < 0.05 uncorrected (see Table 2, Fig. 2).


Figure 2
View larger version (55K):
[in this window]
[in a new window]
 
Figure 2. Left: interactions: stimulus modality- and task-dependent tool-selective activations on transverse slices of a structural image created by averaging the subjects' normalized images. Modality-dependent: tools > animals for pictures > words. Task-dependent: tools > animals for semantic decision > implicit task. Height threshold: P < 0.001, uncorrected for illustration purposes. Extent threshold: >19 voxels, restricted to voxels that showed a significant effect of tool-selectivity and stimulus > fixation. Right: parameter estimates for tools (T, grey) and animals (A, black) relative to fixation during implicit (I) and explicit semantic (S) tasks. The bar graphs represent the size of the effect in adimensional units (corresponding to % whole brain mean). These effects are activations pooled (i.e. summed) over appropriate conditions.

 

View this table:
[in this window]
[in a new window]
 
Table 2 Tool-selective activation

 
We did not detect any tool-selective activation that was enhanced for (i) words relative to pictures or (ii) implicit relative to explicit semantic tasks.

Animals increased responses relative to tools in the right middle occipital and the lateral fusiform gyri. Animal-selective responses in both regions and additional left and right lateral occipito-temporal areas interacted with stimulus modality and were greater when the stimuli were presented as pictures. No animal-selective responses were detected that (i) were enhanced for words relative to pictures or (ii) interacted with task context (see Table 3, Fig. 3).


Figure 3
View larger version (39K):
[in this window]
[in a new window]
 
Figure 3. Left: interactions: stimulus modality-dependent animal-selective activations on transverse slices of a structural image created by averaging the subjects' normalized images. Animals > tools for pictures > words. Height threshold: P < 0.001, uncorrected for illustration purposes. Extent threshold: >19 voxels, restricted to voxels that showed a significant effect of animal-selectivity and stimulus > fixation. Right: parameter estimates for tools (T, grey) and animals (A, black) relative to fixation during implicit (I) and explicit semantic (S) task. The bar graphs represent the size of the effect in adimensional units (corresponding to % whole brain mean). These effects are activations pooled (i.e. summed) over appropriate conditions.

 
In summary, a ventral object recognition system, comprising occipito-temporal regions showed modality-dependent category-selective effects, while a dorsal visuo-motor system showed task-dependent category-effects. Our DCM analysis addressed how this dissociation was mediated in terms of functional integration.

Effective Connectivity Analysis

First, we found that tool pictures enabled the forward connections from OCC to the tool-selective left posterior medial fusiform and AIP areas. Furthermore, this effect was significantly greater for tool pictures than tool words, i.e. there was a significant modulatory effect of the stimulus modality by category interaction on the forward connections (fusiform: P < 0.001; AIP: P < 0.05). These results imply that modality-dependent category-selective responses can be explained by modulation or selective enabling of forward connections, in the context of tool pictures.

Second, left prefrontal areas that showed greater responses during explicit semantic tasks exerted more top-down influence on the fusiform and AIP regions when subjects were actively engaged in semantic tasks on tools than on animals. These results demonstrate that task-dependent category-selective responses can be explained in terms of category-sensitive modulation of backward connections, during explicit semantic tasks on tools.

Finally, the effect of the stimulus modality x category interaction was greater for the forward connections from early visual areas to the fusiform region than to AIP (P < 0.01). Conversely, the task-dependent category-effect of tools was greater for backward connections from the left prefrontal area to the AIP than the fusiform area (P < 0.05). These results demonstrate that the distinct patterns of category selectivity over regions can be explained by differences in top-down and bottom-up influences that show a dorso-ventral dissociation (i.e. differences in modulatory effects between connections to the fusiform and AIP; see Tables 4 and 5, Fig. 4).


View this table:
[in this window]
[in a new window]
 
Table 4 DCM regions

 

View this table:
[in this window]
[in a new window]
 
Table 5 Modulatory effect on forward and backward connections

 
In a subsequent analysis, we investigated the neural mechanisms that mediate modality-dependent animal-selective responses in the ventral occipito-temporal cortex using a DCM model including the STG, OCC and the animal-selective right lateral posterior fusiform area. Similar to our DCM analysis for tools, we found increased forward connections from OCC to the animal-selective right lateral posterior fusiform area for animal pictures relative to animal words i.e. there was a significant modulatory effect of the stimulus modality by category interaction on the forward connections. In short, we reached equivalent conclusions for the modality-dependent animal-selective activations in the ventral occipito-temporal cortex (detailed results not reported).

In summary, we found that ventral category-effects could be explained by a stimulus modality-dependent increase in bottom-up category-specific influences, whereas dorsal regions were subject primarily to category-selective top-down influences of task-related prefrontal activity.

Effect of Gender on Modulatory Effects

At the random effects level, we compared modulatory effects between female and male subjects. This analysis did not reveal any gender effects (P > 0.05).

Effect of Performance on Modulatory Effects

To further characterize the connectivity results, we investigated the effect of subject's performance on the modulatory effects (see Buchel et al., 1999Go; Goncalves and Hall, 2003Go; Glabus et al., 2003Go) using subject-specific reaction times as predictors for the connection strengths. First, we used the reaction time difference for tools — animals during semantic decision tasks to predict the tool-effect on backward connections from the prefrontal cortex. Second, we used the reaction time difference for tools — animals during picture conditions to predict the tool picture effect on the forward connections from the occipital cortex. Finally, we used the reaction time difference for tools — animals during written word conditions to predict the modulatory tool written word effect on forward connections from the occipital cortex. None of these regression analyses revealed a significant relation between reaction time and connection strength.


    Discussion
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Supplementary Material
 References
 
Our results demonstrate robust category-selective responses in multiple cortical regions: Within the fusiform gyrus, category-selective activations were found medially for tools and laterally for animals. In addition, tools elicited increased responses in a left-lateralized visuo-motor action system encompassing ventral premotor, anterior intraparietal and posterior middle temporal regions. Critically, in the ventral occipito-temporal cortex, tool-selective activations were observed irrespective of task but depended on stimulus modality (picture versus words). In contrast, tool-selective responses in the dorsal visuo-motor action system emerged irrespective of modality but were modulated by task. Therefore, category selectivity rests on the interaction of semantic content with either (i) stimulus-bound factors such as modality or (ii) task. From a cognitive perspective, category-selective responses may be better understood in terms of the cognitive operations induced by a semantically invested stimulus in a particular context, rather than its semantic content alone. In particular, our results demonstrate a dorso-ventral dissociation with ventral occipito-temporal regions engaged by stimulus-bound structural processing and dorsal visuo-motor action regions by task-induced semantic operations. In terms of neural mechanisms, our results suggest that the stimulus modality- and task-dependent tool-selective responses are not properties intrinsic to a region but are mediated by changes in the influence of, or the responsiveness to, other regions (Mesulam, 1990Go; Buchel and Friston, 2000Go; McIntosh, 2000Go; Friston and Price, 2001Go; Horwitz, 2003Go). These two distinct classes of tool-selectivity can be explained by differential top-down and bottom up influences for task and modality-dependent effects respectively.

The tool- and animal-selective responses within the ventral occipito-temporal cortex are consistent with numerous studies of object recognition demonstrating focal regions with preferential responses to various semantic categories, including faces, houses and chairs (Ishai et al., 1999Go; Haxby et al., 2001Go; Spiridon and Kanwisher, 2002Go). A recent study reported ventral category-selective activations that were mediated by bottom-up effects during perception and top-down effects during imagery (Mechelli et al., 2004Go). In our study, category-selective responses in the occipito-temporal cortex were modulated by stimulus modality and were evident only for pictures, irrespective of the task context. According to our DCM, this functional specialization is not an intrinsic property of the ventral occipito-temporal regions, but is mediated via bottom up mechanisms that render them especially responsive to certain patterns of input from early visual areas during object perception. Collectively, these results suggest that the ventral occipito-temporal regions are specialized for processing structural features that are sufficiently abstract to be shared by different exemplars of the same category. These structural features permit object categorization during perception and possibly imagery.

In contrast to the modality-dependent category-selective responses in the ventral occipito-temporal cortex, the tool-selective responses in the dorsal visuo-motor action system showed a distinct activation pattern: The tool-selective responses in the left inferior/middle temporal area (lpMT), anterior inferior parietal sulcus (AIP) and ventral pre-motor cortex (i.e. the putative homologue of area F5) were observed irrespective of the stimulus modality. These three regions correspond to those with the highest lesion overlap in patients with impaired action retrieval (Tranel et al., 2003Go) and have been implicated in tool and action observation and retrieval by previous functional imaging studies (Grezes and Decety, 2001Go; Hauk et al., 2004Go). In the macaque, neurons in areas F5 and AIP have been identified that respond selectively to action execution, observation and presentation of graspable objects (Rizzolatti and Arbib, 1998Go; Rizzolatti and Luppino, 2001Go). Our study demonstrates that lpMT and AIP in humans respond to both tool pictures and names suggesting a role in semantic processing. However, their responses were not obligatory but strongly context-sensitive with tool-selective responses being enhanced when subjects process stimuli at a deeper semantic level. Consistent with studies in primates and neuropsychology that have implicated the left prefrontal cortex as a key player in top-down control processes (Fuster, 1989Go; Miller, 2000Go), our DCM analysis demonstrated that task-dependent tool-selectivity is mediated via increased backward influences from the left prefrontal cortex to AIP during semantic decisions on tools. Thus, tool-related action responses, for instance in AIP, might be enabled during explicit semantic tasks by top-down modulation from the prefrontal cortex.

The DCMs discussed so far have established bottom-up and top-down modulations as sufficient explanations for modality- and task-dependent category selectivity. Obviously, most brain regions will — to a certain degree — be exposed to both bottom-up and top-down influences. Our study also demonstrated significant bottom up and top-down influences for AIP and the fusiform region. Directly comparing the modulatory components of connections to the left posterior fusiform and AIP regions demonstrated that (i) modality-dependent bottom-up category effects were greater for the fusiform than the AIP region and (ii) task-dependent top-down category effects were greater for the AIP than the fusiform region. Thus, distinct classes of category selectivity in the AIP and left posterior medial fusiform regions can result from differential enabling of ventral and dorsal connections.

Further evidence for distinct functional roles of the dorsal visuo-motor system and the ventral occipito-temporal cortex in tool processing is provided by two recent studies: the first (Chao et al., 2002Go) manipulated semantic category (animals versus tools) and visual experience (primed versus unprimed), and demonstrated a priming-induced response reduction selectively for tools in LPMT, but non-selectively in the medial fusiform region. The second (Beauchamp et al., 2003Go) manipulated (i) semantic type (i.e. human motion versus tool motion) and (ii) stimulus display (real objects versus point light display) in a factorial design and showed a tool-selective response in LPMT irrespective of stimulus display but in the medial fusiform region primarily for real tool motion. These results suggest that the tool-selective responses in occipito-temporal regions are strongly influenced by stimulus-bound factors such as modality (pictures versus words), display (real objects versus point lights) or perceptual priming.

In conclusion, our results demonstrate two classes of category selectivity: in the ventral occipito-temporal cortex, category-selective responses were observed primarily for pictures and mediated by bottom-up effects. In lpMT and AIP, they were observed during semantic decision tasks and mediated by increased top-down modulation from left prefrontal cortex. These distinct activation and connectivity patterns suggest that the two classes of category-selective systems may support different cognitive operations with ventral occipito-temporal regions engaged in structural processing and dorsal visuo-motor regions activated during strategic semantic processing. Consistent with current semantic theories that emphasize the link between tools and action features, we thus provide evidence that explicit semantic processing of tools relies on re-activating their associated action representations via top-down modulation (Damasio, 1989Go; Martin and Chao, 2001Go; Barsalou et al., 2003Go).


    Supplementary Material
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Supplementary Material
 References
 
Colour versions of Figures 1–4, available as supplementary material, can be found at: http://www.cercor.oupjournals.org.


    Acknowledgments
 
U.N., K.F., W.P. and C.P. were supported by the Wellcome Trust. We thank the radiographers at the Functional Imaging Laboratory for their assistance in collecting the data.


    References
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Supplementary Material
 References
 
Barsalou LW, Kyle SW, Barbey AK, Wilson CD (2003) Grounding conceptual knowledge in modality-specific systems. Trends Cogn Sci 7:84–91.[CrossRef][Web of Science][Medline]

Beauchamp MS, Lee KE, Haxby JV, Martin A (2003) FMRI responses to video and point-light displays of moving humans and manipulable objects. J Cogn Neurosci 15:991–1001.[CrossRef][Web of Science][Medline]

Buchel C, Friston K (2000) Assessing interactions among neuronal systems using functional neuroimaging. Neural Networks 13:871–882.[CrossRef][Web of Science][Medline]

Buchel C, Coull JT, Friston KJ (1999) The predictive value of changes in effective connectivity for human learning. Science 283:1538–1541.[Abstract/Free Full Text]

Capitani E, Laiacona M, Mahon B, Caramazza A (2003) What are the facts semantic category-specific deficits? A critical review of the clinical evidence. Cogn Neuropsychol 20:213–262.[CrossRef][Web of Science]

Chao LL, Martin A (2000) Representation of manipulable man-made objects in the dorsal stream. Neuroimage 12:478–484.[CrossRef][Web of Science][Medline]

Chao LL, Haxby JV, Martin A (1999) Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nat Neurosci 2:913–919.[CrossRef][Web of Science][Medline]

Chao LL, Weisberg J, Martin A (2002) Experience-dependent modulation of category-related cortical activity. Cereb Cortex 12:545–551.[Abstract/Free Full Text]

Damasio AR (1989) Time-locked multiregional retroactivation: a systems-level proposal for the neural substrates of recall and recognition. Cognition 33:25–62.[CrossRef][Web of Science][Medline]

Damasio H, Grabowski TJ, Tranel D, Hichwa RD, Damasio AR (1996) A neural basis for lexical retrieval. Nature 380:499–505. [Erratum published in Nature 381:810.][CrossRef][Medline]

Devlin JT, Moore CJ, Mummery CJ, Gorno-Tempini ML, Phillips JA, Noppeney U, Frackowiak RS, Friston KJ, Price CJ (2002) Anatomic constraints on cognitive theories of category specificity. Neuroimage 15:675–685.[CrossRef][Web of Science][Medline]

Friston KJ, Price CJ (2001) Generative models, brain function and neuroimaging. Scand J Psychol 42:167–177.[CrossRef][Web of Science][Medline]

Friston KJ, Holmes A, Worsley KJ, Poline JB, Frith CD, Frackowiak R (1995) Statistical parametric mapping:a general linear approach. Hum Brain Mapping 2:189–210.[CrossRef]

Friston KJ, Holmes AP, Price CJ, Buchel C, Worsley KJ (1999) Multisubject fMRI studies and conjunction analyses. Neuroimage 10:385–396.[CrossRef][Web of Science][Medline]

Friston KJ, Harrison L, Penny W (2003) Dynamic causal modelling. Neuroimage 19:1273–1302.[CrossRef][Web of Science][Medline]

Fuster JM (1989) The prefrontal cortex. New York: Raven Press.

Gainotti G, Giustolisi L, Daniele A, Silveri MC (1995) Neuroanatomical correlates of category-specific semantic disorders: a critical survet. Memory 3:247–264.[Web of Science][Medline]

Glabus MF, Horwitz B, Holt JL, Kohn PD, Gerton BK, Callicott JH, Meyer-Lindenberg A, Berman KF (2003) Interindividual differences in functional interactions among prefrontal, parietal and parahippocampal regions during working memory. Cereb Cortex 13:1352–1361.[Abstract/Free Full Text]

Goncalves MS, Hall DA (2003) Connectivity analysis with structural equation modelling: an example of the effects of voxel selection. Neuroimage 20:1455–1467.[CrossRef][Web of Science][Medline]

Grabowski TJ, Damasio H, Damasio AR (1998) Premotor and prefrontal correlates of category-related lexical retrieval. Neuroimage 7:232–243.[CrossRef][Web of Science][Medline]

Grafton ST, Arbib MA, Fadiga L, Rizzolatti G (1996) Localization of grasp representations in humans by positron emission tomography. 2. Observation compared with imagination. Exp Brain Res 112:103–11.[Web of Science][Medline]

Grezes J, Decety J (2001) Functional anatomy of execution, mental simulation, observation, and verb generation of actions: a meta-analysis. Hum Brain Mapp 12:1–19.[CrossRef][Web of Science][Medline]

Hauk O, Johnsrude I, Pulvermuller F (2004) Somatotopic representation of action words in human motor and premotor cortex. Neuron 41:301–307.[CrossRef][Web of Science][Medline]

Haxby JV, Gobbini MI, Furey ML, Ishai A, Schouten JL, Pietrini P (2001) Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293:2425–2430.[Abstract/Free Full Text]

Horwitz B (2003) The elusive concept of brain connectivity. Neuroimage 19:466–470.[CrossRef][Web of Science][Medline]

Humphreys GW, Forde EM (2001) Hierarchies, similarity, and interactivity in object recognition: ‘category-specific’ neuropsychological deficits. Behav Brain Sci 24:453–476.[Web of Science][Medline]

Ishai A, Ungerleider LG, Martin A, Schouten JL, Haxby JV (1999) Distributed representation of objects in the human ventral visual pathway. Proc Natl Acad Sci USA 96:9379–84.[Abstract/Free Full Text]

Josephs O, Deichmann R, Turner R (2000) Trajectory measurement and generalized reconstruction in rectilinear EPI. ISMRM meeting, 1517.

Kellenbach M, Brett M, Patterson K (2002) Action speak louder than functions. The importance of manipulability and action in tool representation. J Cogn Neurosci (in press).

Martin A, Chao LL (2001) Semantic memory and the brain:structure and processes. Curr Opin Neurobiol 11:194–201.[CrossRef][Web of Science][Medline]

Martin A, Wiggs CL, Ungerleider LG, Haxby JV (1996) Neural correlates of category-specific knowledge. Nature 379:649–52.[CrossRef][Medline]

McIntosh AR (2000) Towards a network theory of cognition. Neural Networks 13:861–870.[CrossRef][Web of Science][Medline]

Mechelli A, Price CJ, Friston KJ, Ishai A (2004) Where bottom-up meets top-down: neuronal interactions during perception and imagery. Cereb Cortex 14:1256–1265.[Abstract/Free Full Text]

Mesulam MM (1990) Large-scale neurocognitive networks and distributed processing for attention, language, and memory. Ann Neurol 28:597–613.[CrossRef][Web of Science][Medline]

Miller EK (2000) The prefrontal cortex and cognitive control. Nat Rev Neurosci 1:59–65.[CrossRef][Web of Science][Medline]

Price CJ, Wise RJ, Frackowiak RS (1996) Demonstrating the implicit processing of visually presented words and pseudowords. Cereb Cortex 6:62–70.[Abstract/Free Full Text]

Rizzolatti G, Arbib MA (1998) Language within our grasp. Trends Neurosci 21:188–94.[CrossRef][Web of Science][Medline]

Rizzolatti G, Luppino G (2001) The cortical motor system. Neuron 31:889–901.[CrossRef][Web of Science][Medline]

Rizzolatti G, Fadiga L, Matelli M, Bettinardi V, Paulesu E, Perani D, Fazio F (1996) Localization of grasp representations in humans by PET. 1. Observation versus execution. Exp Brain Res 111:246–52.[Web of Science][Medline]

Spiridon M, Kanwisher N (2002) How distributed is visual category information in human occipito-temporal cortex? An fMRI study. Neuron 35:1157–1165.[CrossRef][Web of Science][Medline]

Talairach J, Tournoux P (1988) Co-planar stereotaxic atlas of the human brain. Stuttgart: Thieme.

Tranel D, Kemmerer D, Adolphs R, Damasio H, Damasio AR (2003) Neural correlates of conceptual knowledge. Cogn Neuropsychol 20:409–432.[CrossRef][Web of Science]

Warrington EK, Shallice T (1984) Category specific semantic impairments. Brain 107:829–54.[Abstract/Free Full Text]


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
Cereb CortexHome page
S. Werner and U. Noppeney
Superadditive Responses in Superior Temporal Sulcus Predict Audiovisual Benefits in Object Categorization
Cereb Cortex, November 18, 2009; (2009) bhp248v1.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
A. P. Leff, T. M. Schofield, K. E. Stephan, J. T. Crinion, K. J. Friston, and C. J. Price
The Cortical Dynamics of Intelligible Speech
J. Neurosci., December 3, 2008; 28(49): 13209 - 13215.
[Abstract] [Full Text] [PDF]


Home page
Proc. Natl. Acad. Sci. USAHome page
J. Almeida, B. Z. Mahon, K. Nakayama, and A. Caramazza
Unconscious processing dissociates along categorical lines
PNAS, September 30, 2008; 105(39): 15214 - 15218.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
H. E. Schendan and C. E. Stern
Where Vision Meets Memory: Prefrontal-Posterior Networks for Visual Object Constancy during Categorization and Recognition
Cereb Cortex, July 1, 2008; 18(7): 1695 - 1711.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
J. Fan, P. R. Hof, K. G. Guise, J. A. Fossella, and M. I. Posner
The Functional Integration of the Anterior Cingulate Cortex during Conflict Processing
Cereb Cortex, April 1, 2008; 18(4): 796 - 805.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
U. Noppeney, O. Josephs, J. Hocking, C. J. Price, and K. J. Friston
The Effect of Prior Visual Information on Recognition of Speech and Sounds
Cereb Cortex, March 1, 2008; 18(3): 598 - 609.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
S. J. H. Ebisch, C. Babiloni, C. Del Gratta, A. Ferretti, M. G. Perrucci, M. Caulo, M. M. Sitskoorn, and G. L. Romani
Human Neural Systems for Conceptual Knowledge of Proper Object Use: A Functional Magnetic Resonance Imaging Study
Cereb Cortex, November 1, 2007; 17(11): 2744 - 2751.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
S. L. Fairhall and A. Ishai
Effective Connectivity within the Distributed Cortical Network for Face Perception
Cereb Cortex, October 1, 2007; 17(10): 2400 - 2406.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow Supplementary Material
Right arrow All Versions of this Article:
16/3/437    most recent
bhi123v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (34)
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Noppeney, U.
Right arrow Articles by Friston, K. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Noppeney, U.
Right arrow Articles by Friston, K. J.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?