Cargando…

Disrupted reinforcement learning during post-error slowing in ADHD

ADHD is associated with altered dopamine regulated reinforcement learning on prediction errors. Despite evidence of categorically altered error processing in ADHD, neuroimaging advances have largely investigated models of normal reinforcement learning in greater detail. Further, although reinforceme...

Descripción completa

Detalles Bibliográficos
Autores principales: Chevrier, Andre, Bhaijiwala, Mehereen, Lipszyc, Jonathan, Cheyne, Douglas, Graham, Simon, Schachar, Russell
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6382150/
https://www.ncbi.nlm.nih.gov/pubmed/30785885
http://dx.doi.org/10.1371/journal.pone.0206780
_version_ 1783396619097473024
author Chevrier, Andre
Bhaijiwala, Mehereen
Lipszyc, Jonathan
Cheyne, Douglas
Graham, Simon
Schachar, Russell
author_facet Chevrier, Andre
Bhaijiwala, Mehereen
Lipszyc, Jonathan
Cheyne, Douglas
Graham, Simon
Schachar, Russell
author_sort Chevrier, Andre
collection PubMed
description ADHD is associated with altered dopamine regulated reinforcement learning on prediction errors. Despite evidence of categorically altered error processing in ADHD, neuroimaging advances have largely investigated models of normal reinforcement learning in greater detail. Further, although reinforcement leaning critically relies on ventral striatum exerting error magnitude related thresholding influences on substantia nigra (SN) and dorsal striatum, these thresholding influences have never been identified with neuroimaging. To identify such thresholding influences, we propose that error magnitude related activities must first be separated from opposite activities in overlapping neural regions during error detection. Here we separate error detection from magnitude related adjustment (post-error slowing) during inhibition errors in the stop signal task in typically developing (TD) and ADHD adolescents using fMRI. In TD, we predicted that: 1) deactivation of dorsal striatum on error detection interrupts ongoing processing, and should be proportional to right frontoparietal response phase activity that has been observed in the SST; 2) deactivation of ventral striatum on post-error slowing exerts thresholding influences on, and should be proportional to activity in dorsal striatum. In ADHD, we predicted that ventral striatum would instead correlate with heightened amygdala responses to errors. We found deactivation of dorsal striatum on error detection correlated with response-phase activity in both groups. In TD, post-error slowing deactivation of ventral striatum correlated with activation of dorsal striatum. In ADHD, ventral striatum correlated with heightened amygdala activity. Further, heightened activities in locus coeruleus (norepinephrine), raphe nucleus (serotonin) and medial septal nuclei (acetylcholine), which all compete for control of DA, and are altered in ADHD, exhibited altered correlations with SN. All correlations in TD were replicated in healthy adults. Results in TD are consistent with dopamine regulated reinforcement learning on post-error slowing. In ADHD, results are consistent with heightened activities in the amygdala and non-dopaminergic neurotransmitter nuclei preventing reinforcement learning.
format Online
Article
Text
id pubmed-6382150
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-63821502019-03-01 Disrupted reinforcement learning during post-error slowing in ADHD Chevrier, Andre Bhaijiwala, Mehereen Lipszyc, Jonathan Cheyne, Douglas Graham, Simon Schachar, Russell PLoS One Research Article ADHD is associated with altered dopamine regulated reinforcement learning on prediction errors. Despite evidence of categorically altered error processing in ADHD, neuroimaging advances have largely investigated models of normal reinforcement learning in greater detail. Further, although reinforcement leaning critically relies on ventral striatum exerting error magnitude related thresholding influences on substantia nigra (SN) and dorsal striatum, these thresholding influences have never been identified with neuroimaging. To identify such thresholding influences, we propose that error magnitude related activities must first be separated from opposite activities in overlapping neural regions during error detection. Here we separate error detection from magnitude related adjustment (post-error slowing) during inhibition errors in the stop signal task in typically developing (TD) and ADHD adolescents using fMRI. In TD, we predicted that: 1) deactivation of dorsal striatum on error detection interrupts ongoing processing, and should be proportional to right frontoparietal response phase activity that has been observed in the SST; 2) deactivation of ventral striatum on post-error slowing exerts thresholding influences on, and should be proportional to activity in dorsal striatum. In ADHD, we predicted that ventral striatum would instead correlate with heightened amygdala responses to errors. We found deactivation of dorsal striatum on error detection correlated with response-phase activity in both groups. In TD, post-error slowing deactivation of ventral striatum correlated with activation of dorsal striatum. In ADHD, ventral striatum correlated with heightened amygdala activity. Further, heightened activities in locus coeruleus (norepinephrine), raphe nucleus (serotonin) and medial septal nuclei (acetylcholine), which all compete for control of DA, and are altered in ADHD, exhibited altered correlations with SN. All correlations in TD were replicated in healthy adults. Results in TD are consistent with dopamine regulated reinforcement learning on post-error slowing. In ADHD, results are consistent with heightened activities in the amygdala and non-dopaminergic neurotransmitter nuclei preventing reinforcement learning. Public Library of Science 2019-02-20 /pmc/articles/PMC6382150/ /pubmed/30785885 http://dx.doi.org/10.1371/journal.pone.0206780 Text en © 2019 Chevrier et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Chevrier, Andre
Bhaijiwala, Mehereen
Lipszyc, Jonathan
Cheyne, Douglas
Graham, Simon
Schachar, Russell
Disrupted reinforcement learning during post-error slowing in ADHD
title Disrupted reinforcement learning during post-error slowing in ADHD
title_full Disrupted reinforcement learning during post-error slowing in ADHD
title_fullStr Disrupted reinforcement learning during post-error slowing in ADHD
title_full_unstemmed Disrupted reinforcement learning during post-error slowing in ADHD
title_short Disrupted reinforcement learning during post-error slowing in ADHD
title_sort disrupted reinforcement learning during post-error slowing in adhd
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6382150/
https://www.ncbi.nlm.nih.gov/pubmed/30785885
http://dx.doi.org/10.1371/journal.pone.0206780
work_keys_str_mv AT chevrierandre disruptedreinforcementlearningduringposterrorslowinginadhd
AT bhaijiwalamehereen disruptedreinforcementlearningduringposterrorslowinginadhd
AT lipszycjonathan disruptedreinforcementlearningduringposterrorslowinginadhd
AT cheynedouglas disruptedreinforcementlearningduringposterrorslowinginadhd
AT grahamsimon disruptedreinforcementlearningduringposterrorslowinginadhd
AT schacharrussell disruptedreinforcementlearningduringposterrorslowinginadhd