Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

Worth the work? Monkeys discount rewards by a subjective adapting effort cost

View ORCID ProfileMark Burrell, View ORCID ProfileAlexandre Pastor-Bernier, View ORCID ProfileWolfram Schultz
doi: https://doi.org/10.1101/2023.01.10.523384
Mark Burrell
1Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Mark Burrell
Alexandre Pastor-Bernier
1Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Alexandre Pastor-Bernier
Wolfram Schultz
1Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Wolfram Schultz
  • For correspondence: Wolfram.Schultz@protonmail.com
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Preview PDF
Loading

Abstract

All life must solve how to allocate limited energy resources to maximise benefits from scarce opportunities. Economic theory posits decision makers optimise choice by maximising the subjective benefit (utility) of reward minus the subjective cost (disutility) of the required effort. While successful in many settings, this model does not fully account for how experience can alter reward-effort trade-offs. Here we test how well the subtractive model of effort disutility explains the behavior of two non-human primates (Macaca mulatta) in a binary choice task in which reward quantity and physical effort to obtain were varied.Applying random utility modelling to independently estimate reward utility and effort disutility, we show the subtractive effort model better explains out-of-sample choice behavior when compared to parabolic and exponential effort discounting. Furthermore, we demonstrate that effort disutility is dependent on previous experience of effort: in analogy to work from behavioral labour economics, we develop a model of reference-dependent effort disutility to explain the increased willingness to expend effort following previous experience of effortful options in a session. The result of this analysis suggests that monkeys discount reward by an effort cost that is measured relative to an expected effort learned from previous trials. When this subjective cost of effort, a function of context and experience, is accounted for, trial-by-trial choice behavior can be explained by the subtractive cost model of effort.Therefore, in searching for net utility signals that may underpin effort-based decision-making in the brain, careful measurement of subjective effort costs is an essential first step.

Significance All decision-makers need to consider how much effort they need to expend when evaluating potential options. Economic theories suggest that the optimal way to choose is by cost-benefit analysis of reward against effort. To be able to do this efficiently over many decision contexts, this needs to be done flexibly, with appropriate adaptation to context and experience. Therefore, in aiming to understand how this might be achieved in the brain, it is important to first carefully measure the subjective cost of effort. Here we show monkeys make reward-effort cost-benefit decisions, subtracting the subjective cost of effort from the subjective value of rewards. Moreover, the subjective cost of effort is dependent on the monkeys’ experience of effort in previous trials.

Competing Interest Statement

The authors have declared no competing interest.

Footnotes

  • Competing Interest Statement: The authors declare no competing interests.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted January 10, 2023.
Download PDF
Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Worth the work? Monkeys discount rewards by a subjective adapting effort cost
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Worth the work? Monkeys discount rewards by a subjective adapting effort cost
Mark Burrell, Alexandre Pastor-Bernier, Wolfram Schultz
bioRxiv 2023.01.10.523384; doi: https://doi.org/10.1101/2023.01.10.523384
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Worth the work? Monkeys discount rewards by a subjective adapting effort cost
Mark Burrell, Alexandre Pastor-Bernier, Wolfram Schultz
bioRxiv 2023.01.10.523384; doi: https://doi.org/10.1101/2023.01.10.523384

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neuroscience
Subject Areas
All Articles
  • Animal Behavior and Cognition (4861)
  • Biochemistry (10811)
  • Bioengineering (8054)
  • Bioinformatics (27346)
  • Biophysics (13999)
  • Cancer Biology (11140)
  • Cell Biology (16087)
  • Clinical Trials (138)
  • Developmental Biology (8793)
  • Ecology (13307)
  • Epidemiology (2067)
  • Evolutionary Biology (17375)
  • Genetics (11694)
  • Genomics (15939)
  • Immunology (11042)
  • Microbiology (26132)
  • Molecular Biology (10669)
  • Neuroscience (56660)
  • Paleontology (420)
  • Pathology (1737)
  • Pharmacology and Toxicology (3009)
  • Physiology (4557)
  • Plant Biology (9648)
  • Scientific Communication and Education (1617)
  • Synthetic Biology (2695)
  • Systems Biology (6985)
  • Zoology (1511)