Cerebral Cortex Advance Access originally published online on June 22, 2007
Cerebral Cortex 2008 18(3):652-663; doi:10.1093/cercor/bhm097
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Expected Value, Reward Outcome, and Temporal Difference Error Representations in a Probabilistic Decision Task
University of Oxford, Department of Experimental Psychology, South Parks Road, Oxford OX1 3UD, UK
Address correspondence to email: edmund.rolls{at}psy.ox.ac.uk; web address: http://www.cns.ox.ac.uk.
In probabilistic decision tasks, an expected value (EV) of a choice is calculated, and after the choice has been made, this can be updated based on a temporal difference (TD) prediction error between the EV and the reward magnitude (RM) obtained. The EV is measured as the probability of obtaining a reward x RM. To understand the contribution of different brain areas to these decision-making processes, functional magnetic resonance imaging activations related to EV versus RM (or outcome) were measured in a probabilistic decision task. Activations in the medial orbitofrontal cortex were correlated with both RM and with EV and confirmed in a conjunction analysis to extend toward the pregenual cingulate cortex. From these representations, TD reward prediction errors could be produced. Activations in areas that receive from the orbitofrontal cortex including the ventral striatum, midbrain, and inferior frontal gyrus were correlated with the TD error. Activations in the anterior insula were correlated negatively with EV, occurring when low reward outcomes were expected, and also with the uncertainty of the reward, implicating this region in basic and crucial decision-making parameters, low expected outcomes, and uncertainty.
Key Words: expected utility • expected value • fMRI • insula • orbitofrontal cortex • reward magnitude • reward outcome • temporal difference error • ventral striatum
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  T. A. Hare, J. O'Doherty, C. F. Camerer, W. Schultz, and A. Rangel Dissociating the Role of the Orbitofrontal Cortex and the Striatum in the Computation of Goal Values and Prediction Errors J. Neurosci., May 28, 2008; 28(22): 5623 - 5630. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. Preuschoff, S. R. Quartz, and P. Bossaerts Human Insula Activation Reflects Risk Prediction Errors As Well As Risk J. Neurosci., March 12, 2008; 28(11): 2745 - 2752. [Abstract] [Full Text] [PDF]
|
|