Cargando…

Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning

Theories of decision-making and its neural substrates have long assumed the existence of two distinct and competing valuation systems, variously described as goal-directed vs. habitual, or, more recently and based on statistical arguments, as model-free vs. model-based reinforcement-learning. Though...

Descripción completa

Detalles Bibliográficos
Autores principales: Schad, Daniel J., Jünger, Elisabeth, Sebold, Miriam, Garbusow, Maria, Bernhardt, Nadine, Javadi, Amir-Homayoun, Zimmermann, Ulrich S., Smolka, Michael N., Heinz, Andreas, Rapp, Michael A., Huys, Quentin J. M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2014
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4269125/
https://www.ncbi.nlm.nih.gov/pubmed/25566131
http://dx.doi.org/10.3389/fpsyg.2014.01450
_version_ 1782349326843904000
author Schad, Daniel J.
Jünger, Elisabeth
Sebold, Miriam
Garbusow, Maria
Bernhardt, Nadine
Javadi, Amir-Homayoun
Zimmermann, Ulrich S.
Smolka, Michael N.
Heinz, Andreas
Rapp, Michael A.
Huys, Quentin J. M.
author_facet Schad, Daniel J.
Jünger, Elisabeth
Sebold, Miriam
Garbusow, Maria
Bernhardt, Nadine
Javadi, Amir-Homayoun
Zimmermann, Ulrich S.
Smolka, Michael N.
Heinz, Andreas
Rapp, Michael A.
Huys, Quentin J. M.
author_sort Schad, Daniel J.
collection PubMed
description Theories of decision-making and its neural substrates have long assumed the existence of two distinct and competing valuation systems, variously described as goal-directed vs. habitual, or, more recently and based on statistical arguments, as model-free vs. model-based reinforcement-learning. Though both have been shown to control choices, the cognitive abilities associated with these systems are under ongoing investigation. Here we examine the link to cognitive abilities, and find that individual differences in processing speed covary with a shift from model-free to model-based choice control in the presence of above-average working memory function. This suggests shared cognitive and neural processes; provides a bridge between literatures on intelligence and valuation; and may guide the development of process models of different valuation components. Furthermore, it provides a rationale for individual differences in the tendency to deploy valuation systems, which may be important for understanding the manifold neuropsychiatric diseases associated with malfunctions of valuation.
format Online
Article
Text
id pubmed-4269125
institution National Center for Biotechnology Information
language English
publishDate 2014
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-42691252015-01-06 Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning Schad, Daniel J. Jünger, Elisabeth Sebold, Miriam Garbusow, Maria Bernhardt, Nadine Javadi, Amir-Homayoun Zimmermann, Ulrich S. Smolka, Michael N. Heinz, Andreas Rapp, Michael A. Huys, Quentin J. M. Front Psychol Neuroscience Theories of decision-making and its neural substrates have long assumed the existence of two distinct and competing valuation systems, variously described as goal-directed vs. habitual, or, more recently and based on statistical arguments, as model-free vs. model-based reinforcement-learning. Though both have been shown to control choices, the cognitive abilities associated with these systems are under ongoing investigation. Here we examine the link to cognitive abilities, and find that individual differences in processing speed covary with a shift from model-free to model-based choice control in the presence of above-average working memory function. This suggests shared cognitive and neural processes; provides a bridge between literatures on intelligence and valuation; and may guide the development of process models of different valuation components. Furthermore, it provides a rationale for individual differences in the tendency to deploy valuation systems, which may be important for understanding the manifold neuropsychiatric diseases associated with malfunctions of valuation. Frontiers Media S.A. 2014-12-17 /pmc/articles/PMC4269125/ /pubmed/25566131 http://dx.doi.org/10.3389/fpsyg.2014.01450 Text en Copyright © 2014 Schad, Jünger, Sebold, Garbusow, Bernhardt, Javadi, Zimmermann, Smolka, Heinz, Rapp and Huys. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Schad, Daniel J.
Jünger, Elisabeth
Sebold, Miriam
Garbusow, Maria
Bernhardt, Nadine
Javadi, Amir-Homayoun
Zimmermann, Ulrich S.
Smolka, Michael N.
Heinz, Andreas
Rapp, Michael A.
Huys, Quentin J. M.
Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning
title Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning
title_full Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning
title_fullStr Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning
title_full_unstemmed Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning
title_short Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning
title_sort processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4269125/
https://www.ncbi.nlm.nih.gov/pubmed/25566131
http://dx.doi.org/10.3389/fpsyg.2014.01450
work_keys_str_mv AT schaddanielj processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning
AT jungerelisabeth processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning
AT seboldmiriam processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning
AT garbusowmaria processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning
AT bernhardtnadine processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning
AT javadiamirhomayoun processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning
AT zimmermannulrichs processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning
AT smolkamichaeln processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning
AT heinzandreas processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning
AT rappmichaela processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning
AT huysquentinjm processingspeedenhancesmodelbasedovermodelfreereinforcementlearninginthepresenceofhighworkingmemoryfunctioning