Cargando…

Normative decision rules in changing environments

Models based on normative principles have played a major role in our understanding of how the brain forms decisions. However, these models have typically been derived for simple, stable conditions, and their relevance to decisions formed under more naturalistic, dynamic conditions is unclear. We pre...

Descripción completa

Detalles Bibliográficos
Autores principales: Barendregt, Nicholas W, Gold, Joshua I, Josić, Krešimir, Kilpatrick, Zachary P
Formato: Online Artículo Texto
Lenguaje:English
Publicado: eLife Sciences Publications, Ltd 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9754630/
https://www.ncbi.nlm.nih.gov/pubmed/36282065
http://dx.doi.org/10.7554/eLife.79824
_version_ 1784851242876403712
author Barendregt, Nicholas W
Gold, Joshua I
Josić, Krešimir
Kilpatrick, Zachary P
author_facet Barendregt, Nicholas W
Gold, Joshua I
Josić, Krešimir
Kilpatrick, Zachary P
author_sort Barendregt, Nicholas W
collection PubMed
description Models based on normative principles have played a major role in our understanding of how the brain forms decisions. However, these models have typically been derived for simple, stable conditions, and their relevance to decisions formed under more naturalistic, dynamic conditions is unclear. We previously derived a normative decision model in which evidence accumulation is adapted to fluctuations in the evidence-generating process that occur during a single decision (Glaze et al., 2015), but the evolution of commitment rules (e.g. thresholds on the accumulated evidence) under dynamic conditions is not fully understood. Here, we derive a normative model for decisions based on changing contexts, which we define as changes in evidence quality or reward, over the course of a single decision. In these cases, performance (reward rate) is maximized using decision thresholds that respond to and even anticipate these changes, in contrast to the static thresholds used in many decision models. We show that these adaptive thresholds exhibit several distinct temporal motifs that depend on the specific predicted and experienced context changes and that adaptive models perform robustly even when implemented imperfectly (noisily). We further show that decision models with adaptive thresholds outperform those with constant or urgency-gated thresholds in accounting for human response times on a task with time-varying evidence quality and average reward. These results further link normative and neural decision-making while expanding our view of both as dynamic, adaptive processes that update and use expectations to govern both deliberation and commitment.
format Online
Article
Text
id pubmed-9754630
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher eLife Sciences Publications, Ltd
record_format MEDLINE/PubMed
spelling pubmed-97546302022-12-16 Normative decision rules in changing environments Barendregt, Nicholas W Gold, Joshua I Josić, Krešimir Kilpatrick, Zachary P eLife Computational and Systems Biology Models based on normative principles have played a major role in our understanding of how the brain forms decisions. However, these models have typically been derived for simple, stable conditions, and their relevance to decisions formed under more naturalistic, dynamic conditions is unclear. We previously derived a normative decision model in which evidence accumulation is adapted to fluctuations in the evidence-generating process that occur during a single decision (Glaze et al., 2015), but the evolution of commitment rules (e.g. thresholds on the accumulated evidence) under dynamic conditions is not fully understood. Here, we derive a normative model for decisions based on changing contexts, which we define as changes in evidence quality or reward, over the course of a single decision. In these cases, performance (reward rate) is maximized using decision thresholds that respond to and even anticipate these changes, in contrast to the static thresholds used in many decision models. We show that these adaptive thresholds exhibit several distinct temporal motifs that depend on the specific predicted and experienced context changes and that adaptive models perform robustly even when implemented imperfectly (noisily). We further show that decision models with adaptive thresholds outperform those with constant or urgency-gated thresholds in accounting for human response times on a task with time-varying evidence quality and average reward. These results further link normative and neural decision-making while expanding our view of both as dynamic, adaptive processes that update and use expectations to govern both deliberation and commitment. eLife Sciences Publications, Ltd 2022-10-25 /pmc/articles/PMC9754630/ /pubmed/36282065 http://dx.doi.org/10.7554/eLife.79824 Text en © 2022, Barendregt et al https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use and redistribution provided that the original author and source are credited.
spellingShingle Computational and Systems Biology
Barendregt, Nicholas W
Gold, Joshua I
Josić, Krešimir
Kilpatrick, Zachary P
Normative decision rules in changing environments
title Normative decision rules in changing environments
title_full Normative decision rules in changing environments
title_fullStr Normative decision rules in changing environments
title_full_unstemmed Normative decision rules in changing environments
title_short Normative decision rules in changing environments
title_sort normative decision rules in changing environments
topic Computational and Systems Biology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9754630/
https://www.ncbi.nlm.nih.gov/pubmed/36282065
http://dx.doi.org/10.7554/eLife.79824
work_keys_str_mv AT barendregtnicholasw normativedecisionrulesinchangingenvironments
AT goldjoshuai normativedecisionrulesinchangingenvironments
AT josickresimir normativedecisionrulesinchangingenvironments
AT kilpatrickzacharyp normativedecisionrulesinchangingenvironments