Asymmetric effects of acute stress on cost and benefit learning

Psychoneuroendocrinology. 2022 Apr:138:105646. doi: 10.1016/j.psyneuen.2021.105646. Epub 2021 Dec 24.

Abstract

Background: Humans are continuously exposed to stressful challenges in everyday life. Such stressful events trigger a complex physiological reaction - the fight-or-flight response - that can hamper flexible decision-making and learning. Inspired by key neural and peripheral characteristics of the fight-or-flight response, here, we ask whether acute stress changes how humans learn about costs and benefits.

Methods: Healthy adults were randomly exposed to an acute stress (age mean=23.48, 21/40 female) or no-stress control (age mean=23.80, 22/40 female) condition, after which they completed a reinforcement learning task in which they minimize cost (physical effort) and maximize benefits (monetary rewards). During the task pupillometry data were collected. A computational model of cost-benefit reinforcement learning was employed to investigate the effect of acute stress on cost and benefit learning and decision-making.

Results: Acute stress improved learning to maximize rewards relative to minimizing physical effort (Condition-by-Trial Type interaction: F(1,78)= 6.53, p = 0.01, n2G= 0.04; reward > effort in stress condition: t(39) = 5.40, p < 0.01). Computational modelling revealed that asymmetric learning could be explained by changes in the learning rates of reward value and action cost [condition-by-learning rate (αR, αE) interaction: F(1,78)= 6.42, p = 0.01, n2G= 0.03; αE> αR in control condition: t(39) = -4.75, p < 0.001]. This process was associated with distinct alterations in pupil size fluctuations. Data and scripts are available (https://osf.io/ydv2q/).

Conclusions: Here we demonstrate that acute stress is associated with asymmetric learning about reward value versus action cost, thereby providing new insights into learning strategies under acute stress, which, depending on the context, may be maladaptive or beneficial. Our pupillometry and physiological results tentatively link asymmetric cost and benefit learning to stress-related changes in catecholamine activity.

Keywords: Acute stress; Computational modelling; Costs and benefits; Effort; Reinforcement learning; Reward.

Publication types

  • Randomized Controlled Trial

MeSH terms

  • Adult
  • Cost-Benefit Analysis
  • Decision Making* / physiology
  • Female
  • Humans
  • Learning / physiology
  • Male
  • Reinforcement, Psychology
  • Reward*
  • Young Adult