Cerebral Cortex Advance Access published online on June 22, 2007
Cerebral Cortex, doi:10.1093/cercor/bhm097
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Expected Value, Reward Outcome, and Temporal Difference Error Representations in a Probabilistic Decision Task
University of Oxford, Department of Experimental Psychology, South Parks Road, Oxford OX1 3UD, UK
Address correspondence to email: edmund.rolls{at}psy.ox.ac.uk; web address: http://www.cns.ox.ac.uk.
In probabilistic decision tasks, an expected value (EV) of a choice is calculated, and after the choice has been made, this can be updated based on a temporal difference (TD) prediction error between the EV and the reward magnitude (RM) obtained. The EV is measured as the probability of obtaining a reward x RM. To understand the contribution of different brain areas to these decision-making processes, functional magnetic resonance imaging activations related to EV versus RM (or outcome) were measured in a probabilistic decision task. Activations in the medial orbitofrontal cortex were correlated with both RM and with EV and confirmed in a conjunction analysis to extend toward the pregenual cingulate cortex. From these representations, TD reward prediction errors could be produced. Activations in areas that receive from the orbitofrontal cortex including the ventral striatum, midbrain, and inferior frontal gyrus were correlated with the TD error. Activations in the anterior insula were correlated negatively with EV, occurring when low reward outcomes were expected, and also with the uncertainty of the reward, implicating this region in basic and crucial decision-making parameters, low expected outcomes, and uncertainty.
Key Words: expected utility • expected value • fMRI • insula • orbitofrontal cortex • reward magnitude • reward outcome • temporal difference error • ventral striatum
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  C. Padoa-Schioppa Range-Adapting Representation of Economic Value in the Orbitofrontal Cortex J. Neurosci., November 4, 2009; 29(44): 14004 - 14014. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
G. I. Christopoulos, P. N. Tobler, P. Bossaerts, R. J. Dolan, and W. Schultz Neural Correlates of Value, Risk, and Risk Aversion Contributing to Decision Making under Risk J. Neurosci., October 7, 2009; 29(40): 12574 - 12583. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 F. Grabenhorst, E. T. Rolls, B. A. Parris, and A. A. d'Souza How the Brain Represents the Reward Value of Fat in the Mouth Cereb Cortex, August 14, 2009; (2009) bhp169v1. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 T. A. Hare, C. F. Camerer, and A. Rangel Self-Control in Decision-Making Involves Modulation of the vmPFC Valuation System Science, May 1, 2009; 324(5927): 646 - 648. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K.-i. Okada, K. Toyama, Y. Inoue, T. Isa, and Y. Kobayashi Different Pedunculopontine Tegmental Neurons Signal Predicted and Actual Task Rewards J. Neurosci., April 15, 2009; 29(15): 4858 - 4870. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. De Martino, D. Kumaran, B. Holt, and R. J. Dolan The Neurobiology of Reference-Dependent Value Computation J. Neurosci., March 25, 2009; 29(12): 3833 - 3842. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Beckmann, H. Johansen-Berg, and M. F. S. Rushworth Connectivity-Based Parcellation of Human Cingulate Cortex and Its Relation to Functional Specialization J. Neurosci., January 28, 2009; 29(4): 1175 - 1190. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. d'Acremont and P. Bossaerts Neurobiological studies of risk assessment: A comparison of expected utility and mean-variance approaches Cogn Affect Behav Neurosci, December 1, 2008; 8(4): 363 - 374. [Abstract] [PDF]
|
|
|
|
|
|
M. X. COHEN Neurocomputational mechanisms of reinforcement-guided learning in humans: A review Cogn Affect Behav Neurosci, June 1, 2008; 8(2): 113 - 125. [Abstract] [PDF]
|
|
|
|
|
|
T. A. Hare, J. O'Doherty, C. F. Camerer, W. Schultz, and A. Rangel Dissociating the Role of the Orbitofrontal Cortex and the Striatum in the Computation of Goal Values and Prediction Errors J. Neurosci., May 28, 2008; 28(22): 5623 - 5630. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. Preuschoff, S. R. Quartz, and P. Bossaerts Human Insula Activation Reflects Risk Prediction Errors As Well As Risk J. Neurosci., March 12, 2008; 28(11): 2745 - 2752. [Abstract] [Full Text] [PDF]
|
|