Cargando…

Effects of methylphenidate on reinforcement learning depend on working memory capacity

RATIONALE: Brain catecholamines have long been implicated in reinforcement learning, exemplified by catecholamine drug and genetic effects on probabilistic reversal learning. However, the mechanisms underlying such effects are unclear. OBJECTIVES AND METHODS: Here we investigated effects of an acute...

Descripción completa

Detalles Bibliográficos
Autores principales: Rostami Kandroodi, Mojtaba, Cook, Jennifer L., Swart, Jennifer C., Froböse, Monja I., Geurts, Dirk E. M., Vahabie, Abdol-Hossein, Nili Ahmadabadi, Majid, Cools, Roshan, den Ouden, Hanneke E. M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Berlin Heidelberg 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8629893/
https://www.ncbi.nlm.nih.gov/pubmed/34676440
http://dx.doi.org/10.1007/s00213-021-05974-w
_version_ 1784607303489552384
author Rostami Kandroodi, Mojtaba
Cook, Jennifer L.
Swart, Jennifer C.
Froböse, Monja I.
Geurts, Dirk E. M.
Vahabie, Abdol-Hossein
Nili Ahmadabadi, Majid
Cools, Roshan
den Ouden, Hanneke E. M.
author_facet Rostami Kandroodi, Mojtaba
Cook, Jennifer L.
Swart, Jennifer C.
Froböse, Monja I.
Geurts, Dirk E. M.
Vahabie, Abdol-Hossein
Nili Ahmadabadi, Majid
Cools, Roshan
den Ouden, Hanneke E. M.
author_sort Rostami Kandroodi, Mojtaba
collection PubMed
description RATIONALE: Brain catecholamines have long been implicated in reinforcement learning, exemplified by catecholamine drug and genetic effects on probabilistic reversal learning. However, the mechanisms underlying such effects are unclear. OBJECTIVES AND METHODS: Here we investigated effects of an acute catecholamine challenge with methylphenidate (20 mg, oral) on a novel probabilistic reversal learning paradigm in a within-subject, double-blind randomised design. The paradigm was designed to disentangle effects on punishment avoidance from effects on reward perseveration. Given the known large individual variability in methylphenidate’s effects, we stratified our effects by working memory capacity and trait impulsivity, putatively modulating the effects of methylphenidate, in a large sample (n = 102) of healthy volunteers. RESULTS: Contrary to our prediction, methylphenidate did not alter performance in the reversal phase of the task. Our key finding is that methylphenidate altered learning of choice-outcome contingencies in a manner that depended on individual variability in working memory span. Specifically, methylphenidate improved performance by adaptively reducing the effective learning rate in participants with higher working memory capacity. CONCLUSIONS: This finding emphasises the important role of working memory in reinforcement learning, as reported in influential recent computational modelling and behavioural work, and highlights the dependence of this interplay on catecholaminergic function. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s00213-021-05974-w.
format Online
Article
Text
id pubmed-8629893
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Springer Berlin Heidelberg
record_format MEDLINE/PubMed
spelling pubmed-86298932021-12-15 Effects of methylphenidate on reinforcement learning depend on working memory capacity Rostami Kandroodi, Mojtaba Cook, Jennifer L. Swart, Jennifer C. Froböse, Monja I. Geurts, Dirk E. M. Vahabie, Abdol-Hossein Nili Ahmadabadi, Majid Cools, Roshan den Ouden, Hanneke E. M. Psychopharmacology (Berl) Original Investigation RATIONALE: Brain catecholamines have long been implicated in reinforcement learning, exemplified by catecholamine drug and genetic effects on probabilistic reversal learning. However, the mechanisms underlying such effects are unclear. OBJECTIVES AND METHODS: Here we investigated effects of an acute catecholamine challenge with methylphenidate (20 mg, oral) on a novel probabilistic reversal learning paradigm in a within-subject, double-blind randomised design. The paradigm was designed to disentangle effects on punishment avoidance from effects on reward perseveration. Given the known large individual variability in methylphenidate’s effects, we stratified our effects by working memory capacity and trait impulsivity, putatively modulating the effects of methylphenidate, in a large sample (n = 102) of healthy volunteers. RESULTS: Contrary to our prediction, methylphenidate did not alter performance in the reversal phase of the task. Our key finding is that methylphenidate altered learning of choice-outcome contingencies in a manner that depended on individual variability in working memory span. Specifically, methylphenidate improved performance by adaptively reducing the effective learning rate in participants with higher working memory capacity. CONCLUSIONS: This finding emphasises the important role of working memory in reinforcement learning, as reported in influential recent computational modelling and behavioural work, and highlights the dependence of this interplay on catecholaminergic function. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s00213-021-05974-w. Springer Berlin Heidelberg 2021-10-21 2021 /pmc/articles/PMC8629893/ /pubmed/34676440 http://dx.doi.org/10.1007/s00213-021-05974-w Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Original Investigation
Rostami Kandroodi, Mojtaba
Cook, Jennifer L.
Swart, Jennifer C.
Froböse, Monja I.
Geurts, Dirk E. M.
Vahabie, Abdol-Hossein
Nili Ahmadabadi, Majid
Cools, Roshan
den Ouden, Hanneke E. M.
Effects of methylphenidate on reinforcement learning depend on working memory capacity
title Effects of methylphenidate on reinforcement learning depend on working memory capacity
title_full Effects of methylphenidate on reinforcement learning depend on working memory capacity
title_fullStr Effects of methylphenidate on reinforcement learning depend on working memory capacity
title_full_unstemmed Effects of methylphenidate on reinforcement learning depend on working memory capacity
title_short Effects of methylphenidate on reinforcement learning depend on working memory capacity
title_sort effects of methylphenidate on reinforcement learning depend on working memory capacity
topic Original Investigation
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8629893/
https://www.ncbi.nlm.nih.gov/pubmed/34676440
http://dx.doi.org/10.1007/s00213-021-05974-w
work_keys_str_mv AT rostamikandroodimojtaba effectsofmethylphenidateonreinforcementlearningdependonworkingmemorycapacity
AT cookjenniferl effectsofmethylphenidateonreinforcementlearningdependonworkingmemorycapacity
AT swartjenniferc effectsofmethylphenidateonreinforcementlearningdependonworkingmemorycapacity
AT frobosemonjai effectsofmethylphenidateonreinforcementlearningdependonworkingmemorycapacity
AT geurtsdirkem effectsofmethylphenidateonreinforcementlearningdependonworkingmemorycapacity
AT vahabieabdolhossein effectsofmethylphenidateonreinforcementlearningdependonworkingmemorycapacity
AT niliahmadabadimajid effectsofmethylphenidateonreinforcementlearningdependonworkingmemorycapacity
AT coolsroshan effectsofmethylphenidateonreinforcementlearningdependonworkingmemorycapacity
AT denoudenhannekeem effectsofmethylphenidateonreinforcementlearningdependonworkingmemorycapacity