Cargando…
Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning
Theories of decision-making and its neural substrates have long assumed the existence of two distinct and competing valuation systems, variously described as goal-directed vs. habitual, or, more recently and based on statistical arguments, as model-free vs. model-based reinforcement-learning. Though...
Autores principales: | , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2014
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4269125/ https://www.ncbi.nlm.nih.gov/pubmed/25566131 http://dx.doi.org/10.3389/fpsyg.2014.01450 |
_version_ | 1782349326843904000 |
---|---|
author | Schad, Daniel J. Jünger, Elisabeth Sebold, Miriam Garbusow, Maria Bernhardt, Nadine Javadi, Amir-Homayoun Zimmermann, Ulrich S. Smolka, Michael N. Heinz, Andreas Rapp, Michael A. Huys, Quentin J. M. |
author_facet | Schad, Daniel J. Jünger, Elisabeth Sebold, Miriam Garbusow, Maria Bernhardt, Nadine Javadi, Amir-Homayoun Zimmermann, Ulrich S. Smolka, Michael N. Heinz, Andreas Rapp, Michael A. Huys, Quentin J. M. |
author_sort | Schad, Daniel J. |
collection | PubMed |
description | Theories of decision-making and its neural substrates have long assumed the existence of two distinct and competing valuation systems, variously described as goal-directed vs. habitual, or, more recently and based on statistical arguments, as model-free vs. model-based reinforcement-learning. Though both have been shown to control choices, the cognitive abilities associated with these systems are under ongoing investigation. Here we examine the link to cognitive abilities, and find that individual differences in processing speed covary with a shift from model-free to model-based choice control in the presence of above-average working memory function. This suggests shared cognitive and neural processes; provides a bridge between literatures on intelligence and valuation; and may guide the development of process models of different valuation components. Furthermore, it provides a rationale for individual differences in the tendency to deploy valuation systems, which may be important for understanding the manifold neuropsychiatric diseases associated with malfunctions of valuation. |
format | Online Article Text |
id | pubmed-4269125 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2014 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-42691252015-01-06 Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning Schad, Daniel J. Jünger, Elisabeth Sebold, Miriam Garbusow, Maria Bernhardt, Nadine Javadi, Amir-Homayoun Zimmermann, Ulrich S. Smolka, Michael N. Heinz, Andreas Rapp, Michael A. Huys, Quentin J. M. Front Psychol Neuroscience Theories of decision-making and its neural substrates have long assumed the existence of two distinct and competing valuation systems, variously described as goal-directed vs. habitual, or, more recently and based on statistical arguments, as model-free vs. model-based reinforcement-learning. Though both have been shown to control choices, the cognitive abilities associated with these systems are under ongoing investigation. Here we examine the link to cognitive abilities, and find that individual differences in processing speed covary with a shift from model-free to model-based choice control in the presence of above-average working memory function. This suggests shared cognitive and neural processes; provides a bridge between literatures on intelligence and valuation; and may guide the development of process models of different valuation components. Furthermore, it provides a rationale for individual differences in the tendency to deploy valuation systems, which may be important for understanding the manifold neuropsychiatric diseases associated with malfunctions of valuation. Frontiers Media S.A. 2014-12-17 /pmc/articles/PMC4269125/ /pubmed/25566131 http://dx.doi.org/10.3389/fpsyg.2014.01450 Text en Copyright © 2014 Schad, Jünger, Sebold, Garbusow, Bernhardt, Javadi, Zimmermann, Smolka, Heinz, Rapp and Huys. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Schad, Daniel J. Jünger, Elisabeth Sebold, Miriam Garbusow, Maria Bernhardt, Nadine Javadi, Amir-Homayoun Zimmermann, Ulrich S. Smolka, Michael N. Heinz, Andreas Rapp, Michael A. Huys, Quentin J. M. Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning |
title | Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning |
title_full | Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning |
title_fullStr | Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning |
title_full_unstemmed | Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning |
title_short | Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning |
title_sort | processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4269125/ https://www.ncbi.nlm.nih.gov/pubmed/25566131 http://dx.doi.org/10.3389/fpsyg.2014.01450 |
work_keys_str_mv | AT schaddanielj processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning AT jungerelisabeth processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning AT seboldmiriam processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning AT garbusowmaria processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning AT bernhardtnadine processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning AT javadiamirhomayoun processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning AT zimmermannulrichs processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning AT smolkamichaeln processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning AT heinzandreas processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning AT rappmichaela processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning AT huysquentinjm processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning |