Cargando…
Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder
RATIONALE: Drug addiction has been suggested to develop through drug-induced changes in learning and memory processes. Whilst the initiation of drug use is typically goal-directed and hedonically motivated, over time, drug-taking may develop into a stimulus-driven habit, characterised by persistent...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer Berlin Heidelberg
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6695345/ https://www.ncbi.nlm.nih.gov/pubmed/31372665 http://dx.doi.org/10.1007/s00213-019-05330-z |
_version_ | 1783444017874206720 |
---|---|
author | Lim, T. V. Cardinal, R. N. Savulich, G. Jones, P. S. Moustafa, A. A. Robbins, T. W. Ersche, K. D. |
author_facet | Lim, T. V. Cardinal, R. N. Savulich, G. Jones, P. S. Moustafa, A. A. Robbins, T. W. Ersche, K. D. |
author_sort | Lim, T. V. |
collection | PubMed |
description | RATIONALE: Drug addiction has been suggested to develop through drug-induced changes in learning and memory processes. Whilst the initiation of drug use is typically goal-directed and hedonically motivated, over time, drug-taking may develop into a stimulus-driven habit, characterised by persistent use of the drug irrespective of the consequences. Converging lines of evidence suggest that stimulant drugs facilitate the transition of goal-directed into habitual drug-taking, but their contribution to goal-directed learning is less clear. Computational modelling may provide an elegant means for elucidating changes during instrumental learning that may explain enhanced habit formation. OBJECTIVES: We used formal reinforcement learning algorithms to deconstruct the process of appetitive instrumental learning and to explore potential associations between goal-directed and habitual actions in patients with cocaine use disorder (CUD). METHODS: We re-analysed appetitive instrumental learning data in 55 healthy control volunteers and 70 CUD patients by applying a reinforcement learning model within a hierarchical Bayesian framework. We used a regression model to determine the influence of learning parameters and variations in brain structure on subsequent habit formation. RESULTS: Poor instrumental learning performance in CUD patients was largely determined by difficulties with learning from feedback, as reflected by a significantly reduced learning rate. Subsequent formation of habitual response patterns was partly explained by group status and individual variation in reinforcement sensitivity. White matter integrity within goal-directed networks was only associated with performance parameters in controls but not in CUD patients. CONCLUSIONS: Our data indicate that impairments in reinforcement learning are insufficient to account for enhanced habitual responding in CUD. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (10.1007/s00213-019-05330-z) contains supplementary material, which is available to authorized users. |
format | Online Article Text |
id | pubmed-6695345 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Springer Berlin Heidelberg |
record_format | MEDLINE/PubMed |
spelling | pubmed-66953452019-08-28 Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder Lim, T. V. Cardinal, R. N. Savulich, G. Jones, P. S. Moustafa, A. A. Robbins, T. W. Ersche, K. D. Psychopharmacology (Berl) Original Investigation RATIONALE: Drug addiction has been suggested to develop through drug-induced changes in learning and memory processes. Whilst the initiation of drug use is typically goal-directed and hedonically motivated, over time, drug-taking may develop into a stimulus-driven habit, characterised by persistent use of the drug irrespective of the consequences. Converging lines of evidence suggest that stimulant drugs facilitate the transition of goal-directed into habitual drug-taking, but their contribution to goal-directed learning is less clear. Computational modelling may provide an elegant means for elucidating changes during instrumental learning that may explain enhanced habit formation. OBJECTIVES: We used formal reinforcement learning algorithms to deconstruct the process of appetitive instrumental learning and to explore potential associations between goal-directed and habitual actions in patients with cocaine use disorder (CUD). METHODS: We re-analysed appetitive instrumental learning data in 55 healthy control volunteers and 70 CUD patients by applying a reinforcement learning model within a hierarchical Bayesian framework. We used a regression model to determine the influence of learning parameters and variations in brain structure on subsequent habit formation. RESULTS: Poor instrumental learning performance in CUD patients was largely determined by difficulties with learning from feedback, as reflected by a significantly reduced learning rate. Subsequent formation of habitual response patterns was partly explained by group status and individual variation in reinforcement sensitivity. White matter integrity within goal-directed networks was only associated with performance parameters in controls but not in CUD patients. CONCLUSIONS: Our data indicate that impairments in reinforcement learning are insufficient to account for enhanced habitual responding in CUD. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (10.1007/s00213-019-05330-z) contains supplementary material, which is available to authorized users. Springer Berlin Heidelberg 2019-08-01 2019 /pmc/articles/PMC6695345/ /pubmed/31372665 http://dx.doi.org/10.1007/s00213-019-05330-z Text en © The Author(s) 2019 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. |
spellingShingle | Original Investigation Lim, T. V. Cardinal, R. N. Savulich, G. Jones, P. S. Moustafa, A. A. Robbins, T. W. Ersche, K. D. Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder |
title | Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder |
title_full | Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder |
title_fullStr | Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder |
title_full_unstemmed | Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder |
title_short | Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder |
title_sort | impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder |
topic | Original Investigation |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6695345/ https://www.ncbi.nlm.nih.gov/pubmed/31372665 http://dx.doi.org/10.1007/s00213-019-05330-z |
work_keys_str_mv | AT limtv impairmentsinreinforcementlearningdonotexplainenhancedhabitformationincocaineusedisorder AT cardinalrn impairmentsinreinforcementlearningdonotexplainenhancedhabitformationincocaineusedisorder AT savulichg impairmentsinreinforcementlearningdonotexplainenhancedhabitformationincocaineusedisorder AT jonesps impairmentsinreinforcementlearningdonotexplainenhancedhabitformationincocaineusedisorder AT moustafaaa impairmentsinreinforcementlearningdonotexplainenhancedhabitformationincocaineusedisorder AT robbinstw impairmentsinreinforcementlearningdonotexplainenhancedhabitformationincocaineusedisorder AT erschekd impairmentsinreinforcementlearningdonotexplainenhancedhabitformationincocaineusedisorder |