Neuron
Volume 80, Issue 1, 2 October 2013, Pages 223-234
Journal home page for Neuron

Article
Cortical Signals for Rewarded Actions and Strategic Exploration

https://doi.org/10.1016/j.neuron.2013.07.040Get rights and content
Under an Elsevier user license
open archive

Highlights

  • Monkeys exhibit win-stay behavior more frequently than lose-switch behavior

  • Cortical encoding of past choices is more robust after reward

  • Coding of rewarded actions in the SEF increases with switching behaviors

  • Reward-enhanced encoding of past choices is task dependent in the SEF

Summary

In stable environments, decision makers can exploit their previously learned strategies for optimal outcomes, while exploration might lead to better options in unstable environments. Here, to investigate the cortical contributions to exploratory behavior, we analyzed single-neuron activity recorded from four different cortical areas of monkeys performing a matching-pennies task and a visual search task, which encouraged and discouraged exploration, respectively. We found that neurons in multiple regions in the frontal and parietal cortex tended to encode signals related to previously rewarded actions more reliably than unrewarded actions. In addition, signals for rewarded choices in the supplementary eye field were attenuated during the visual search task and were correlated with the tendency to switch choices during the matching-pennies task. These results suggest that the supplementary eye field might play a unique role in encouraging animals to explore alternative decision-making strategies.

Cited by (0)

4

These authors contributed equally to this work