Cargando…
Feature-based learning improves adaptability without compromising precision
Learning from reward feedback is essential for survival but can become extremely challenging with myriad choice options. Here, we propose that learning reward values of individual features can provide a heuristic for estimating reward values of choice options in dynamic, multi-dimensional environmen...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2017
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5700946/ https://www.ncbi.nlm.nih.gov/pubmed/29170381 http://dx.doi.org/10.1038/s41467-017-01874-w |
_version_ | 1783281225313550336 |
---|---|
author | Farashahi, Shiva Rowe, Katherine Aslami, Zohra Lee, Daeyeol Soltani, Alireza |
author_facet | Farashahi, Shiva Rowe, Katherine Aslami, Zohra Lee, Daeyeol Soltani, Alireza |
author_sort | Farashahi, Shiva |
collection | PubMed |
description | Learning from reward feedback is essential for survival but can become extremely challenging with myriad choice options. Here, we propose that learning reward values of individual features can provide a heuristic for estimating reward values of choice options in dynamic, multi-dimensional environments. We hypothesize that this feature-based learning occurs not just because it can reduce dimensionality, but more importantly because it can increase adaptability without compromising precision of learning. We experimentally test this hypothesis and find that in dynamic environments, human subjects adopt feature-based learning even when this approach does not reduce dimensionality. Even in static, low-dimensional environments, subjects initially adopt feature-based learning and gradually switch to learning reward values of individual options, depending on how accurately objects’ values can be predicted by combining feature values. Our computational models reproduce these results and highlight the importance of neurons coding feature values for parallel learning of values for features and objects. |
format | Online Article Text |
id | pubmed-5700946 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2017 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-57009462017-11-27 Feature-based learning improves adaptability without compromising precision Farashahi, Shiva Rowe, Katherine Aslami, Zohra Lee, Daeyeol Soltani, Alireza Nat Commun Article Learning from reward feedback is essential for survival but can become extremely challenging with myriad choice options. Here, we propose that learning reward values of individual features can provide a heuristic for estimating reward values of choice options in dynamic, multi-dimensional environments. We hypothesize that this feature-based learning occurs not just because it can reduce dimensionality, but more importantly because it can increase adaptability without compromising precision of learning. We experimentally test this hypothesis and find that in dynamic environments, human subjects adopt feature-based learning even when this approach does not reduce dimensionality. Even in static, low-dimensional environments, subjects initially adopt feature-based learning and gradually switch to learning reward values of individual options, depending on how accurately objects’ values can be predicted by combining feature values. Our computational models reproduce these results and highlight the importance of neurons coding feature values for parallel learning of values for features and objects. Nature Publishing Group UK 2017-11-24 /pmc/articles/PMC5700946/ /pubmed/29170381 http://dx.doi.org/10.1038/s41467-017-01874-w Text en © The Author(s) 2017 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commonslicense, unless indicated otherwise in a credit line to the material. If material is not included in the article’sCreative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Farashahi, Shiva Rowe, Katherine Aslami, Zohra Lee, Daeyeol Soltani, Alireza Feature-based learning improves adaptability without compromising precision |
title | Feature-based learning improves adaptability without compromising precision |
title_full | Feature-based learning improves adaptability without compromising precision |
title_fullStr | Feature-based learning improves adaptability without compromising precision |
title_full_unstemmed | Feature-based learning improves adaptability without compromising precision |
title_short | Feature-based learning improves adaptability without compromising precision |
title_sort | feature-based learning improves adaptability without compromising precision |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5700946/ https://www.ncbi.nlm.nih.gov/pubmed/29170381 http://dx.doi.org/10.1038/s41467-017-01874-w |
work_keys_str_mv | AT farashahishiva featurebasedlearningimprovesadaptabilitywithoutcompromisingprecision AT rowekatherine featurebasedlearningimprovesadaptabilitywithoutcompromisingprecision AT aslamizohra featurebasedlearningimprovesadaptabilitywithoutcompromisingprecision AT leedaeyeol featurebasedlearningimprovesadaptabilitywithoutcompromisingprecision AT soltanialireza featurebasedlearningimprovesadaptabilitywithoutcompromisingprecision |