Cargando…

Strategically managing learning during perceptual decision making

Making optimal decisions in the face of noise requires balancing short-term speed and accuracy. But a theory of optimality should account for the fact that short-term speed can influence long-term accuracy through learning. Here, we demonstrate that long-term learning is an important dynamical dimen...

Descripción completa

Detalles Bibliográficos
Autores principales: Masís, Javier, Chapman, Travis, Rhee, Juliana Y, Cox, David D, Saxe, Andrew M
Formato: Online Artículo Texto
Lenguaje:English
Publicado: eLife Sciences Publications, Ltd 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9928425/
https://www.ncbi.nlm.nih.gov/pubmed/36786427
http://dx.doi.org/10.7554/eLife.64978
_version_ 1784888649701130240
author Masís, Javier
Chapman, Travis
Rhee, Juliana Y
Cox, David D
Saxe, Andrew M
author_facet Masís, Javier
Chapman, Travis
Rhee, Juliana Y
Cox, David D
Saxe, Andrew M
author_sort Masís, Javier
collection PubMed
description Making optimal decisions in the face of noise requires balancing short-term speed and accuracy. But a theory of optimality should account for the fact that short-term speed can influence long-term accuracy through learning. Here, we demonstrate that long-term learning is an important dynamical dimension of the speed-accuracy trade-off. We study learning trajectories in rats and formally characterize these dynamics in a theory expressed as both a recurrent neural network and an analytical extension of the drift-diffusion model that learns over time. The model reveals that choosing suboptimal response times to learn faster sacrifices immediate reward, but can lead to greater total reward. We empirically verify predictions of the theory, including a relationship between stimulus exposure and learning speed, and a modulation of reaction time by future learning prospects. We find that rats’ strategies approximately maximize total reward over the full learning epoch, suggesting cognitive control over the learning process.
format Online
Article
Text
id pubmed-9928425
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher eLife Sciences Publications, Ltd
record_format MEDLINE/PubMed
spelling pubmed-99284252023-02-15 Strategically managing learning during perceptual decision making Masís, Javier Chapman, Travis Rhee, Juliana Y Cox, David D Saxe, Andrew M eLife Neuroscience Making optimal decisions in the face of noise requires balancing short-term speed and accuracy. But a theory of optimality should account for the fact that short-term speed can influence long-term accuracy through learning. Here, we demonstrate that long-term learning is an important dynamical dimension of the speed-accuracy trade-off. We study learning trajectories in rats and formally characterize these dynamics in a theory expressed as both a recurrent neural network and an analytical extension of the drift-diffusion model that learns over time. The model reveals that choosing suboptimal response times to learn faster sacrifices immediate reward, but can lead to greater total reward. We empirically verify predictions of the theory, including a relationship between stimulus exposure and learning speed, and a modulation of reaction time by future learning prospects. We find that rats’ strategies approximately maximize total reward over the full learning epoch, suggesting cognitive control over the learning process. eLife Sciences Publications, Ltd 2023-02-14 /pmc/articles/PMC9928425/ /pubmed/36786427 http://dx.doi.org/10.7554/eLife.64978 Text en © 2023, Masís et al https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use and redistribution provided that the original author and source are credited.
spellingShingle Neuroscience
Masís, Javier
Chapman, Travis
Rhee, Juliana Y
Cox, David D
Saxe, Andrew M
Strategically managing learning during perceptual decision making
title Strategically managing learning during perceptual decision making
title_full Strategically managing learning during perceptual decision making
title_fullStr Strategically managing learning during perceptual decision making
title_full_unstemmed Strategically managing learning during perceptual decision making
title_short Strategically managing learning during perceptual decision making
title_sort strategically managing learning during perceptual decision making
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9928425/
https://www.ncbi.nlm.nih.gov/pubmed/36786427
http://dx.doi.org/10.7554/eLife.64978
work_keys_str_mv AT masisjavier strategicallymanaginglearningduringperceptualdecisionmaking
AT chapmantravis strategicallymanaginglearningduringperceptualdecisionmaking
AT rheejulianay strategicallymanaginglearningduringperceptualdecisionmaking
AT coxdavidd strategicallymanaginglearningduringperceptualdecisionmaking
AT saxeandrewm strategicallymanaginglearningduringperceptualdecisionmaking