Cargando…

Integrating unsupervised and reinforcement learning in human categorical perception: A computational model

Categorical perception identifies a tuning of human perceptual systems that can occur during the execution of a categorisation task. Despite the fact that experimental studies and computational models suggest that this tuning is influenced by task-independent effects (e.g., based on Hebbian and unsu...

Descripción completa

Detalles Bibliográficos
Autores principales: Granato, Giovanni, Cartoni, Emilio, Da Rold, Federico, Mattera, Andrea, Baldassarre, Gianluca
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9089926/
https://www.ncbi.nlm.nih.gov/pubmed/35536843
http://dx.doi.org/10.1371/journal.pone.0267838
_version_ 1784704620756467712
author Granato, Giovanni
Cartoni, Emilio
Da Rold, Federico
Mattera, Andrea
Baldassarre, Gianluca
author_facet Granato, Giovanni
Cartoni, Emilio
Da Rold, Federico
Mattera, Andrea
Baldassarre, Gianluca
author_sort Granato, Giovanni
collection PubMed
description Categorical perception identifies a tuning of human perceptual systems that can occur during the execution of a categorisation task. Despite the fact that experimental studies and computational models suggest that this tuning is influenced by task-independent effects (e.g., based on Hebbian and unsupervised learning, UL) and task-dependent effects (e.g., based on reward signals and reinforcement learning, RL), no model studies the UL/RL interaction during the emergence of categorical perception. Here we have investigated the effects of this interaction, proposing a system-level neuro-inspired computational architecture in which a perceptual component integrates UL and RL processes. The model has been tested with a categorisation task and the results show that a balanced mix of unsupervised and reinforcement learning leads to the emergence of a suitable categorical perception and the best performance in the task. Indeed, an excessive unsupervised learning contribution tends to not identify task-relevant features while an excessive reinforcement learning contribution tends to initially learn slowly and then to reach sub-optimal performance. These results are consistent with the experimental evidence regarding categorical activations of extrastriate cortices in healthy conditions. Finally, the results produced by the two extreme cases of our model can explain the existence of several factors that may lead to sensory alterations in autistic people.
format Online
Article
Text
id pubmed-9089926
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-90899262022-05-11 Integrating unsupervised and reinforcement learning in human categorical perception: A computational model Granato, Giovanni Cartoni, Emilio Da Rold, Federico Mattera, Andrea Baldassarre, Gianluca PLoS One Research Article Categorical perception identifies a tuning of human perceptual systems that can occur during the execution of a categorisation task. Despite the fact that experimental studies and computational models suggest that this tuning is influenced by task-independent effects (e.g., based on Hebbian and unsupervised learning, UL) and task-dependent effects (e.g., based on reward signals and reinforcement learning, RL), no model studies the UL/RL interaction during the emergence of categorical perception. Here we have investigated the effects of this interaction, proposing a system-level neuro-inspired computational architecture in which a perceptual component integrates UL and RL processes. The model has been tested with a categorisation task and the results show that a balanced mix of unsupervised and reinforcement learning leads to the emergence of a suitable categorical perception and the best performance in the task. Indeed, an excessive unsupervised learning contribution tends to not identify task-relevant features while an excessive reinforcement learning contribution tends to initially learn slowly and then to reach sub-optimal performance. These results are consistent with the experimental evidence regarding categorical activations of extrastriate cortices in healthy conditions. Finally, the results produced by the two extreme cases of our model can explain the existence of several factors that may lead to sensory alterations in autistic people. Public Library of Science 2022-05-10 /pmc/articles/PMC9089926/ /pubmed/35536843 http://dx.doi.org/10.1371/journal.pone.0267838 Text en © 2022 Granato et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Granato, Giovanni
Cartoni, Emilio
Da Rold, Federico
Mattera, Andrea
Baldassarre, Gianluca
Integrating unsupervised and reinforcement learning in human categorical perception: A computational model
title Integrating unsupervised and reinforcement learning in human categorical perception: A computational model
title_full Integrating unsupervised and reinforcement learning in human categorical perception: A computational model
title_fullStr Integrating unsupervised and reinforcement learning in human categorical perception: A computational model
title_full_unstemmed Integrating unsupervised and reinforcement learning in human categorical perception: A computational model
title_short Integrating unsupervised and reinforcement learning in human categorical perception: A computational model
title_sort integrating unsupervised and reinforcement learning in human categorical perception: a computational model
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9089926/
https://www.ncbi.nlm.nih.gov/pubmed/35536843
http://dx.doi.org/10.1371/journal.pone.0267838
work_keys_str_mv AT granatogiovanni integratingunsupervisedandreinforcementlearninginhumancategoricalperceptionacomputationalmodel
AT cartoniemilio integratingunsupervisedandreinforcementlearninginhumancategoricalperceptionacomputationalmodel
AT daroldfederico integratingunsupervisedandreinforcementlearninginhumancategoricalperceptionacomputationalmodel
AT matteraandrea integratingunsupervisedandreinforcementlearninginhumancategoricalperceptionacomputationalmodel
AT baldassarregianluca integratingunsupervisedandreinforcementlearninginhumancategoricalperceptionacomputationalmodel