User profiles for S. J. Gershman

Samuel Gershman

Professor, Harvard University
Verified email at fas.harvard.edu
Cited by 22688

Computational rationality: A converging paradigm for intelligence in brains, minds, and machines

SJ Gershman, EJ Horvitz, JB Tenenbaum - Science, 2015 - science.org
After growing up together, and mostly growing apart in the second half of the 20th century,
the fields of artificial intelligence (AI), cognitive science, and neuroscience are reconverging …

A tutorial on Bayesian nonparametric models

SJ Gershman, DM Blei - Journal of Mathematical Psychology, 2012 - Elsevier
A key problem in statistical modeling is model selection, that is, how to choose a model at an
appropriate level of complexity. This problem appears in many settings, most prominently in …

The successor representation: its computational logic and neural substrates

SJ Gershman - Journal of Neuroscience, 2018 - Soc Neuroscience
Reinforcement learning is the process by which an agent learns to predict long-term future
reward. We now understand a great deal about the brain's reinforcement learning algorithms, …

Building machines that learn and think like people

…, TD Ullman, JB Tenenbaum, SJ Gershman - Behavioral and brain …, 2017 - cambridge.org
Recent progress in artificial intelligence has renewed interest in building systems that learn
and think like people. Many advances have come from using deep neural networks trained …

[HTML][HTML] Model-based influences on humans' choices and striatal prediction errors

ND Daw, SJ Gershman, B Seymour, P Dayan… - Neuron, 2011 - cell.com
The mesostriatal dopamine system is prominently implicated in model-free reinforcement
learning, with fMRI BOLD signals in ventral striatum notably covarying with model-free …

The hippocampus as a predictive map

KL Stachenfeld, MM Botvinick, SJ Gershman - Nature neuroscience, 2017 - nature.com
A cognitive map has long been the dominant metaphor for hippocampal function, embracing
the idea that place cells encode a geometric representation of space. However, evidence …

Reinforcement learning and episodic memory in humans and animals: an integrative framework

SJ Gershman, ND Daw - Annual review of psychology, 2017 - annualreviews.org
We review the psychology and neuroscience of reinforcement learning (RL), which has
experienced significant progress in the past two decades, enabled by the comprehensive …

Context, learning, and extinction.

SJ Gershman, DM Blei, Y Niv - Psychological review, 2010 - psycnet.apa.org
… We thank Nathaniel Daw, Michael Todd, Anatole Gershman, and Ken Norman for helpful
discussions.Correspondence concerning this article should be addressed to Samuel J. …

The successor representation in human reinforcement learning

…, MM Botvinick, ND Daw, SJ Gershman - Nature human …, 2017 - nature.com
Theories of reward learning in neuroscience have focused on two families of algorithms
thought to capture deliberative versus habitual choice. ‘Model-based’ algorithms compute the …

Reinforcement learning in multidimensional environments relies on attention mechanisms

Y Niv, R Daniel, A Geana, SJ Gershman… - Journal of …, 2015 - Soc Neuroscience
In recent years, ideas from the computational field of reinforcement learning have revolutionized
the study of learning in the brain, famously providing new, precise theories of how …