Cargando…
Integrating unsupervised and reinforcement learning in human categorical perception: A computational model
Categorical perception identifies a tuning of human perceptual systems that can occur during the execution of a categorisation task. Despite the fact that experimental studies and computational models suggest that this tuning is influenced by task-independent effects (e.g., based on Hebbian and unsu...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9089926/ https://www.ncbi.nlm.nih.gov/pubmed/35536843 http://dx.doi.org/10.1371/journal.pone.0267838 |
_version_ | 1784704620756467712 |
---|---|
author | Granato, Giovanni Cartoni, Emilio Da Rold, Federico Mattera, Andrea Baldassarre, Gianluca |
author_facet | Granato, Giovanni Cartoni, Emilio Da Rold, Federico Mattera, Andrea Baldassarre, Gianluca |
author_sort | Granato, Giovanni |
collection | PubMed |
description | Categorical perception identifies a tuning of human perceptual systems that can occur during the execution of a categorisation task. Despite the fact that experimental studies and computational models suggest that this tuning is influenced by task-independent effects (e.g., based on Hebbian and unsupervised learning, UL) and task-dependent effects (e.g., based on reward signals and reinforcement learning, RL), no model studies the UL/RL interaction during the emergence of categorical perception. Here we have investigated the effects of this interaction, proposing a system-level neuro-inspired computational architecture in which a perceptual component integrates UL and RL processes. The model has been tested with a categorisation task and the results show that a balanced mix of unsupervised and reinforcement learning leads to the emergence of a suitable categorical perception and the best performance in the task. Indeed, an excessive unsupervised learning contribution tends to not identify task-relevant features while an excessive reinforcement learning contribution tends to initially learn slowly and then to reach sub-optimal performance. These results are consistent with the experimental evidence regarding categorical activations of extrastriate cortices in healthy conditions. Finally, the results produced by the two extreme cases of our model can explain the existence of several factors that may lead to sensory alterations in autistic people. |
format | Online Article Text |
id | pubmed-9089926 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-90899262022-05-11 Integrating unsupervised and reinforcement learning in human categorical perception: A computational model Granato, Giovanni Cartoni, Emilio Da Rold, Federico Mattera, Andrea Baldassarre, Gianluca PLoS One Research Article Categorical perception identifies a tuning of human perceptual systems that can occur during the execution of a categorisation task. Despite the fact that experimental studies and computational models suggest that this tuning is influenced by task-independent effects (e.g., based on Hebbian and unsupervised learning, UL) and task-dependent effects (e.g., based on reward signals and reinforcement learning, RL), no model studies the UL/RL interaction during the emergence of categorical perception. Here we have investigated the effects of this interaction, proposing a system-level neuro-inspired computational architecture in which a perceptual component integrates UL and RL processes. The model has been tested with a categorisation task and the results show that a balanced mix of unsupervised and reinforcement learning leads to the emergence of a suitable categorical perception and the best performance in the task. Indeed, an excessive unsupervised learning contribution tends to not identify task-relevant features while an excessive reinforcement learning contribution tends to initially learn slowly and then to reach sub-optimal performance. These results are consistent with the experimental evidence regarding categorical activations of extrastriate cortices in healthy conditions. Finally, the results produced by the two extreme cases of our model can explain the existence of several factors that may lead to sensory alterations in autistic people. Public Library of Science 2022-05-10 /pmc/articles/PMC9089926/ /pubmed/35536843 http://dx.doi.org/10.1371/journal.pone.0267838 Text en © 2022 Granato et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Granato, Giovanni Cartoni, Emilio Da Rold, Federico Mattera, Andrea Baldassarre, Gianluca Integrating unsupervised and reinforcement learning in human categorical perception: A computational model |
title | Integrating unsupervised and reinforcement learning in human categorical perception: A computational model |
title_full | Integrating unsupervised and reinforcement learning in human categorical perception: A computational model |
title_fullStr | Integrating unsupervised and reinforcement learning in human categorical perception: A computational model |
title_full_unstemmed | Integrating unsupervised and reinforcement learning in human categorical perception: A computational model |
title_short | Integrating unsupervised and reinforcement learning in human categorical perception: A computational model |
title_sort | integrating unsupervised and reinforcement learning in human categorical perception: a computational model |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9089926/ https://www.ncbi.nlm.nih.gov/pubmed/35536843 http://dx.doi.org/10.1371/journal.pone.0267838 |
work_keys_str_mv | AT granatogiovanni integratingunsupervisedandreinforcementlearninginhumancategoricalperceptionacomputationalmodel AT cartoniemilio integratingunsupervisedandreinforcementlearninginhumancategoricalperceptionacomputationalmodel AT daroldfederico integratingunsupervisedandreinforcementlearninginhumancategoricalperceptionacomputationalmodel AT matteraandrea integratingunsupervisedandreinforcementlearninginhumancategoricalperceptionacomputationalmodel AT baldassarregianluca integratingunsupervisedandreinforcementlearninginhumancategoricalperceptionacomputationalmodel |