Cargando…
Strategically managing learning during perceptual decision making
Making optimal decisions in the face of noise requires balancing short-term speed and accuracy. But a theory of optimality should account for the fact that short-term speed can influence long-term accuracy through learning. Here, we demonstrate that long-term learning is an important dynamical dimen...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
eLife Sciences Publications, Ltd
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9928425/ https://www.ncbi.nlm.nih.gov/pubmed/36786427 http://dx.doi.org/10.7554/eLife.64978 |
_version_ | 1784888649701130240 |
---|---|
author | Masís, Javier Chapman, Travis Rhee, Juliana Y Cox, David D Saxe, Andrew M |
author_facet | Masís, Javier Chapman, Travis Rhee, Juliana Y Cox, David D Saxe, Andrew M |
author_sort | Masís, Javier |
collection | PubMed |
description | Making optimal decisions in the face of noise requires balancing short-term speed and accuracy. But a theory of optimality should account for the fact that short-term speed can influence long-term accuracy through learning. Here, we demonstrate that long-term learning is an important dynamical dimension of the speed-accuracy trade-off. We study learning trajectories in rats and formally characterize these dynamics in a theory expressed as both a recurrent neural network and an analytical extension of the drift-diffusion model that learns over time. The model reveals that choosing suboptimal response times to learn faster sacrifices immediate reward, but can lead to greater total reward. We empirically verify predictions of the theory, including a relationship between stimulus exposure and learning speed, and a modulation of reaction time by future learning prospects. We find that rats’ strategies approximately maximize total reward over the full learning epoch, suggesting cognitive control over the learning process. |
format | Online Article Text |
id | pubmed-9928425 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | eLife Sciences Publications, Ltd |
record_format | MEDLINE/PubMed |
spelling | pubmed-99284252023-02-15 Strategically managing learning during perceptual decision making Masís, Javier Chapman, Travis Rhee, Juliana Y Cox, David D Saxe, Andrew M eLife Neuroscience Making optimal decisions in the face of noise requires balancing short-term speed and accuracy. But a theory of optimality should account for the fact that short-term speed can influence long-term accuracy through learning. Here, we demonstrate that long-term learning is an important dynamical dimension of the speed-accuracy trade-off. We study learning trajectories in rats and formally characterize these dynamics in a theory expressed as both a recurrent neural network and an analytical extension of the drift-diffusion model that learns over time. The model reveals that choosing suboptimal response times to learn faster sacrifices immediate reward, but can lead to greater total reward. We empirically verify predictions of the theory, including a relationship between stimulus exposure and learning speed, and a modulation of reaction time by future learning prospects. We find that rats’ strategies approximately maximize total reward over the full learning epoch, suggesting cognitive control over the learning process. eLife Sciences Publications, Ltd 2023-02-14 /pmc/articles/PMC9928425/ /pubmed/36786427 http://dx.doi.org/10.7554/eLife.64978 Text en © 2023, Masís et al https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use and redistribution provided that the original author and source are credited. |
spellingShingle | Neuroscience Masís, Javier Chapman, Travis Rhee, Juliana Y Cox, David D Saxe, Andrew M Strategically managing learning during perceptual decision making |
title | Strategically managing learning during perceptual decision making |
title_full | Strategically managing learning during perceptual decision making |
title_fullStr | Strategically managing learning during perceptual decision making |
title_full_unstemmed | Strategically managing learning during perceptual decision making |
title_short | Strategically managing learning during perceptual decision making |
title_sort | strategically managing learning during perceptual decision making |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9928425/ https://www.ncbi.nlm.nih.gov/pubmed/36786427 http://dx.doi.org/10.7554/eLife.64978 |
work_keys_str_mv | AT masisjavier strategicallymanaginglearningduringperceptualdecisionmaking AT chapmantravis strategicallymanaginglearningduringperceptualdecisionmaking AT rheejulianay strategicallymanaginglearningduringperceptualdecisionmaking AT coxdavidd strategicallymanaginglearningduringperceptualdecisionmaking AT saxeandrewm strategicallymanaginglearningduringperceptualdecisionmaking |