Cargando…

Reward-Guided Learning with and without Causal Attribution

When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that...

Descripción completa

Detalles Bibliográficos
Autores principales: Jocham, Gerhard, Brodersen, Kay H., Constantinescu, Alexandra O., Kahn, Martin C., Ianni, Angela M., Walton, Mark E., Rushworth, Matthew F.S., Behrens, Timothy E.J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cell Press 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4826429/
https://www.ncbi.nlm.nih.gov/pubmed/26971947
http://dx.doi.org/10.1016/j.neuron.2016.02.018
_version_ 1782426332806774784
author Jocham, Gerhard
Brodersen, Kay H.
Constantinescu, Alexandra O.
Kahn, Martin C.
Ianni, Angela M.
Walton, Mark E.
Rushworth, Matthew F.S.
Behrens, Timothy E.J.
author_facet Jocham, Gerhard
Brodersen, Kay H.
Constantinescu, Alexandra O.
Kahn, Martin C.
Ianni, Angela M.
Walton, Mark E.
Rushworth, Matthew F.S.
Behrens, Timothy E.J.
author_sort Jocham, Gerhard
collection PubMed
description When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task.
format Online
Article
Text
id pubmed-4826429
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Cell Press
record_format MEDLINE/PubMed
spelling pubmed-48264292016-04-20 Reward-Guided Learning with and without Causal Attribution Jocham, Gerhard Brodersen, Kay H. Constantinescu, Alexandra O. Kahn, Martin C. Ianni, Angela M. Walton, Mark E. Rushworth, Matthew F.S. Behrens, Timothy E.J. Neuron Article When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task. Cell Press 2016-04-06 /pmc/articles/PMC4826429/ /pubmed/26971947 http://dx.doi.org/10.1016/j.neuron.2016.02.018 Text en © 2016 The Authors http://creativecommons.org/licenses/by/4.0/ This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Jocham, Gerhard
Brodersen, Kay H.
Constantinescu, Alexandra O.
Kahn, Martin C.
Ianni, Angela M.
Walton, Mark E.
Rushworth, Matthew F.S.
Behrens, Timothy E.J.
Reward-Guided Learning with and without Causal Attribution
title Reward-Guided Learning with and without Causal Attribution
title_full Reward-Guided Learning with and without Causal Attribution
title_fullStr Reward-Guided Learning with and without Causal Attribution
title_full_unstemmed Reward-Guided Learning with and without Causal Attribution
title_short Reward-Guided Learning with and without Causal Attribution
title_sort reward-guided learning with and without causal attribution
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4826429/
https://www.ncbi.nlm.nih.gov/pubmed/26971947
http://dx.doi.org/10.1016/j.neuron.2016.02.018
work_keys_str_mv AT jochamgerhard rewardguidedlearningwithandwithoutcausalattribution
AT brodersenkayh rewardguidedlearningwithandwithoutcausalattribution
AT constantinescualexandrao rewardguidedlearningwithandwithoutcausalattribution
AT kahnmartinc rewardguidedlearningwithandwithoutcausalattribution
AT ianniangelam rewardguidedlearningwithandwithoutcausalattribution
AT waltonmarke rewardguidedlearningwithandwithoutcausalattribution
AT rushworthmatthewfs rewardguidedlearningwithandwithoutcausalattribution
AT behrenstimothyej rewardguidedlearningwithandwithoutcausalattribution