Cerebral Cortex Advance Access published online on June 11, 2008
Cerebral Cortex, doi:10.1093/cercor/bhn098
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Determining a Role for Ventromedial Prefrontal Cortex in Encoding Action-Based Value Signals During Reward-Related Decision Making
Division of Humanities and Social Sciences, California Institute of Technology, MC 114-96, 1200 E. California Boulevard, Pasadena, CA 91125
Address correspondence to Jan Gläscher, Division of Humanities and Social Sciences, California Institute of Technology, MC 114-96, Caltech, 1200 E. California Boulevard, Pasadena, CA 91125. Email: glascher{at}hss.caltech.edu.
Considerable evidence has emerged to implicate ventromedial prefrontal cortex in encoding expectations of future reward during value-based decision making. However, the nature of the learned associations upon which such representations depend is much less clear. Here, we aimed to determine whether expected reward representations in this region could be driven by action–outcome associations, rather than being dependent on the associative value assigned to particular discriminative stimuli. Subjects were scanned with functional magnetic resonance imaging while performing 2 variants of a simple reward-related decision task. In one version, subjects made choices between 2 different physical motor responses in the absence of discriminative stimuli, whereas in the other version, subjects chose between 2 different stimuli that were randomly assigned to different responses on a trial-by-trial basis. Using an extension of a reinforcement learning algorithm, we found activity in ventromedial prefrontal cortex tracked expected future reward during the action-based task as well as during the stimulus-based task, indicating that value representations in this region can be driven by action–outcome associations. These findings suggest that ventromedial prefrontal cortex may play a role in encoding the value of chosen actions irrespective of whether those actions denote physical motor responses or more abstract decision options.
Key Words: action value decision making reinforcement learning reversal learning stimulus value ventromedial prefrontal cortex
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
S. Palminteri, T. Boraud, G. Lafargue, B. Dubois, and M. Pessiglione Brain Hemispheres Selectively Track the Expected Value of Contralateral Options J. Neurosci., October 28, 2009; 29(43): 13465 - 13472. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. J. Gershman, B. Pesaran, and N. D. Daw Human Reinforcement Learning Subdivides Structured Action Spaces by Learning Effector-Specific Values J. Neurosci., October 28, 2009; 29(43): 13524 - 13531. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. de Wit, P. R. Corlett, M. R. Aitken, A. Dickinson, and P. C. Fletcher Differential Engagement of the Ventromedial Prefrontal Cortex by Goal-Directed and Habitual Behavior toward Food Pictures in Humans J. Neurosci., September 9, 2009; 29(36): 11330 - 11338. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. G. V. Mitchell, Q. Luo, S. B. Avny, T. Kasprzycki, K. Gupta, G. Chen, E. C. Finger, and R. J. R. Blair Adapting to Dynamic Stimulus-Response Values: Differential Contributions of Inferior Frontal, Dorsomedial, and Dorsolateral Regions of Prefrontal Cortex to Decision Making J. Neurosci., September 2, 2009; 29(35): 10827 - 10834. [Abstract] [Full Text] [PDF] |
||||
