Cargando…

Feature-based learning improves adaptability without compromising precision

Learning from reward feedback is essential for survival but can become extremely challenging with myriad choice options. Here, we propose that learning reward values of individual features can provide a heuristic for estimating reward values of choice options in dynamic, multi-dimensional environmen...

Descripción completa

Detalles Bibliográficos
Autores principales: Farashahi, Shiva, Rowe, Katherine, Aslami, Zohra, Lee, Daeyeol, Soltani, Alireza
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5700946/
https://www.ncbi.nlm.nih.gov/pubmed/29170381
http://dx.doi.org/10.1038/s41467-017-01874-w
_version_ 1783281225313550336
author Farashahi, Shiva
Rowe, Katherine
Aslami, Zohra
Lee, Daeyeol
Soltani, Alireza
author_facet Farashahi, Shiva
Rowe, Katherine
Aslami, Zohra
Lee, Daeyeol
Soltani, Alireza
author_sort Farashahi, Shiva
collection PubMed
description Learning from reward feedback is essential for survival but can become extremely challenging with myriad choice options. Here, we propose that learning reward values of individual features can provide a heuristic for estimating reward values of choice options in dynamic, multi-dimensional environments. We hypothesize that this feature-based learning occurs not just because it can reduce dimensionality, but more importantly because it can increase adaptability without compromising precision of learning. We experimentally test this hypothesis and find that in dynamic environments, human subjects adopt feature-based learning even when this approach does not reduce dimensionality. Even in static, low-dimensional environments, subjects initially adopt feature-based learning and gradually switch to learning reward values of individual options, depending on how accurately objects’ values can be predicted by combining feature values. Our computational models reproduce these results and highlight the importance of neurons coding feature values for parallel learning of values for features and objects.
format Online
Article
Text
id pubmed-5700946
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-57009462017-11-27 Feature-based learning improves adaptability without compromising precision Farashahi, Shiva Rowe, Katherine Aslami, Zohra Lee, Daeyeol Soltani, Alireza Nat Commun Article Learning from reward feedback is essential for survival but can become extremely challenging with myriad choice options. Here, we propose that learning reward values of individual features can provide a heuristic for estimating reward values of choice options in dynamic, multi-dimensional environments. We hypothesize that this feature-based learning occurs not just because it can reduce dimensionality, but more importantly because it can increase adaptability without compromising precision of learning. We experimentally test this hypothesis and find that in dynamic environments, human subjects adopt feature-based learning even when this approach does not reduce dimensionality. Even in static, low-dimensional environments, subjects initially adopt feature-based learning and gradually switch to learning reward values of individual options, depending on how accurately objects’ values can be predicted by combining feature values. Our computational models reproduce these results and highlight the importance of neurons coding feature values for parallel learning of values for features and objects. Nature Publishing Group UK 2017-11-24 /pmc/articles/PMC5700946/ /pubmed/29170381 http://dx.doi.org/10.1038/s41467-017-01874-w Text en © The Author(s) 2017 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commonslicense, unless indicated otherwise in a credit line to the material. If material is not included in the article’sCreative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Farashahi, Shiva
Rowe, Katherine
Aslami, Zohra
Lee, Daeyeol
Soltani, Alireza
Feature-based learning improves adaptability without compromising precision
title Feature-based learning improves adaptability without compromising precision
title_full Feature-based learning improves adaptability without compromising precision
title_fullStr Feature-based learning improves adaptability without compromising precision
title_full_unstemmed Feature-based learning improves adaptability without compromising precision
title_short Feature-based learning improves adaptability without compromising precision
title_sort feature-based learning improves adaptability without compromising precision
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5700946/
https://www.ncbi.nlm.nih.gov/pubmed/29170381
http://dx.doi.org/10.1038/s41467-017-01874-w
work_keys_str_mv AT farashahishiva featurebasedlearningimprovesadaptabilitywithoutcompromisingprecision
AT rowekatherine featurebasedlearningimprovesadaptabilitywithoutcompromisingprecision
AT aslamizohra featurebasedlearningimprovesadaptabilitywithoutcompromisingprecision
AT leedaeyeol featurebasedlearningimprovesadaptabilitywithoutcompromisingprecision
AT soltanialireza featurebasedlearningimprovesadaptabilitywithoutcompromisingprecision