Cargando…

Sensitivity of reaction time to the magnitude of rewards reveals the cost-structure of time

The Drift-Diffusion Model (DDM) is the prevalent computational model of the speed-accuracy trade-off in decision making. The DDM provides an explanation of behavior by optimally balancing reaction times and error rates. However, when applied to value-based decision making, the DDM makes the stark pr...

Descripción completa

Detalles Bibliográficos
Autores principales: Steverson, Kai, Chung, Hui-Kuan, Zimmermann, Jan, Louie, Kenway, Glimcher, Paul
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6934862/
https://www.ncbi.nlm.nih.gov/pubmed/31882745
http://dx.doi.org/10.1038/s41598-019-56392-0
_version_ 1783483482547159040
author Steverson, Kai
Chung, Hui-Kuan
Zimmermann, Jan
Louie, Kenway
Glimcher, Paul
author_facet Steverson, Kai
Chung, Hui-Kuan
Zimmermann, Jan
Louie, Kenway
Glimcher, Paul
author_sort Steverson, Kai
collection PubMed
description The Drift-Diffusion Model (DDM) is the prevalent computational model of the speed-accuracy trade-off in decision making. The DDM provides an explanation of behavior by optimally balancing reaction times and error rates. However, when applied to value-based decision making, the DDM makes the stark prediction that reaction times depend only on the relative utility difference between the options and not on absolute utility magnitudes. This prediction runs counter to evidence that reaction times decrease with higher utility magnitude. Here, we ask if and how it could be optimal for reaction times to show this observed pattern. We study an algorithmic framework that balances the cost of delaying rewards against the utility of obtained rewards. We find that the functional form of the cost of delay plays a key role, with the empirically observed pattern becoming optimal under multiplicative discounting. We add to the empirical literature by testing whether utility magnitude affects reaction times using a novel methodology that does not rely on functional form assumptions for the subjects’ utilities. Our results advance the understanding of how and why reaction times are sensitive to the magnitude of rewards.
format Online
Article
Text
id pubmed-6934862
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-69348622019-12-31 Sensitivity of reaction time to the magnitude of rewards reveals the cost-structure of time Steverson, Kai Chung, Hui-Kuan Zimmermann, Jan Louie, Kenway Glimcher, Paul Sci Rep Article The Drift-Diffusion Model (DDM) is the prevalent computational model of the speed-accuracy trade-off in decision making. The DDM provides an explanation of behavior by optimally balancing reaction times and error rates. However, when applied to value-based decision making, the DDM makes the stark prediction that reaction times depend only on the relative utility difference between the options and not on absolute utility magnitudes. This prediction runs counter to evidence that reaction times decrease with higher utility magnitude. Here, we ask if and how it could be optimal for reaction times to show this observed pattern. We study an algorithmic framework that balances the cost of delaying rewards against the utility of obtained rewards. We find that the functional form of the cost of delay plays a key role, with the empirically observed pattern becoming optimal under multiplicative discounting. We add to the empirical literature by testing whether utility magnitude affects reaction times using a novel methodology that does not rely on functional form assumptions for the subjects’ utilities. Our results advance the understanding of how and why reaction times are sensitive to the magnitude of rewards. Nature Publishing Group UK 2019-12-27 /pmc/articles/PMC6934862/ /pubmed/31882745 http://dx.doi.org/10.1038/s41598-019-56392-0 Text en © The Author(s) 2019 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Steverson, Kai
Chung, Hui-Kuan
Zimmermann, Jan
Louie, Kenway
Glimcher, Paul
Sensitivity of reaction time to the magnitude of rewards reveals the cost-structure of time
title Sensitivity of reaction time to the magnitude of rewards reveals the cost-structure of time
title_full Sensitivity of reaction time to the magnitude of rewards reveals the cost-structure of time
title_fullStr Sensitivity of reaction time to the magnitude of rewards reveals the cost-structure of time
title_full_unstemmed Sensitivity of reaction time to the magnitude of rewards reveals the cost-structure of time
title_short Sensitivity of reaction time to the magnitude of rewards reveals the cost-structure of time
title_sort sensitivity of reaction time to the magnitude of rewards reveals the cost-structure of time
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6934862/
https://www.ncbi.nlm.nih.gov/pubmed/31882745
http://dx.doi.org/10.1038/s41598-019-56392-0
work_keys_str_mv AT steversonkai sensitivityofreactiontimetothemagnitudeofrewardsrevealsthecoststructureoftime
AT chunghuikuan sensitivityofreactiontimetothemagnitudeofrewardsrevealsthecoststructureoftime
AT zimmermannjan sensitivityofreactiontimetothemagnitudeofrewardsrevealsthecoststructureoftime
AT louiekenway sensitivityofreactiontimetothemagnitudeofrewardsrevealsthecoststructureoftime
AT glimcherpaul sensitivityofreactiontimetothemagnitudeofrewardsrevealsthecoststructureoftime