Cargando…

Signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy

We postulate that three fundamental elements underlie a decision making process: perception of time passing, information processing in multiple timescales and reward maximisation. We build a simple reinforcement learning agent upon these principles that we train on a random dot-like task. Our result...

Descripción completa

Detalles Bibliográficos
Autores principales: Manneschi, Luca, Gigante, Guido, Vasilaki, Eleni, Del Giudice, Paolo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9462745/
https://www.ncbi.nlm.nih.gov/pubmed/35930590
http://dx.doi.org/10.1371/journal.pcbi.1009393
_version_ 1784787256837406720
author Manneschi, Luca
Gigante, Guido
Vasilaki, Eleni
Del Giudice, Paolo
author_facet Manneschi, Luca
Gigante, Guido
Vasilaki, Eleni
Del Giudice, Paolo
author_sort Manneschi, Luca
collection PubMed
description We postulate that three fundamental elements underlie a decision making process: perception of time passing, information processing in multiple timescales and reward maximisation. We build a simple reinforcement learning agent upon these principles that we train on a random dot-like task. Our results, similar to the experimental data, demonstrate three emerging signatures. (1) signal neutrality: insensitivity to the signal coherence in the interval preceding the decision. (2) Scalar property: the mean of the response times varies widely for different signal coherences, yet the shape of the distributions stays almost unchanged. (3) Collapsing boundaries: the “effective” decision-making boundary changes over time in a manner reminiscent of the theoretical optimal. Removing the perception of time or the multiple timescales from the model does not preserve the distinguishing signatures. Our results suggest an alternative explanation for signal neutrality. We propose that it is not part of motor planning. It is part of the decision-making process and emerges from information processing on multiple timescales.
format Online
Article
Text
id pubmed-9462745
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-94627452022-09-10 Signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy Manneschi, Luca Gigante, Guido Vasilaki, Eleni Del Giudice, Paolo PLoS Comput Biol Research Article We postulate that three fundamental elements underlie a decision making process: perception of time passing, information processing in multiple timescales and reward maximisation. We build a simple reinforcement learning agent upon these principles that we train on a random dot-like task. Our results, similar to the experimental data, demonstrate three emerging signatures. (1) signal neutrality: insensitivity to the signal coherence in the interval preceding the decision. (2) Scalar property: the mean of the response times varies widely for different signal coherences, yet the shape of the distributions stays almost unchanged. (3) Collapsing boundaries: the “effective” decision-making boundary changes over time in a manner reminiscent of the theoretical optimal. Removing the perception of time or the multiple timescales from the model does not preserve the distinguishing signatures. Our results suggest an alternative explanation for signal neutrality. We propose that it is not part of motor planning. It is part of the decision-making process and emerges from information processing on multiple timescales. Public Library of Science 2022-08-05 /pmc/articles/PMC9462745/ /pubmed/35930590 http://dx.doi.org/10.1371/journal.pcbi.1009393 Text en © 2022 Manneschi et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Manneschi, Luca
Gigante, Guido
Vasilaki, Eleni
Del Giudice, Paolo
Signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy
title Signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy
title_full Signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy
title_fullStr Signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy
title_full_unstemmed Signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy
title_short Signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy
title_sort signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9462745/
https://www.ncbi.nlm.nih.gov/pubmed/35930590
http://dx.doi.org/10.1371/journal.pcbi.1009393
work_keys_str_mv AT manneschiluca signalneutralityscalarpropertyandcollapsingboundariesasconsequencesofalearnedmultitimescalestrategy
AT giganteguido signalneutralityscalarpropertyandcollapsingboundariesasconsequencesofalearnedmultitimescalestrategy
AT vasilakieleni signalneutralityscalarpropertyandcollapsingboundariesasconsequencesofalearnedmultitimescalestrategy
AT delgiudicepaolo signalneutralityscalarpropertyandcollapsingboundariesasconsequencesofalearnedmultitimescalestrategy