Cargando…
Reward-Guided Learning with and without Causal Attribution
When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Cell Press
2016
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4826429/ https://www.ncbi.nlm.nih.gov/pubmed/26971947 http://dx.doi.org/10.1016/j.neuron.2016.02.018 |
_version_ | 1782426332806774784 |
---|---|
author | Jocham, Gerhard Brodersen, Kay H. Constantinescu, Alexandra O. Kahn, Martin C. Ianni, Angela M. Walton, Mark E. Rushworth, Matthew F.S. Behrens, Timothy E.J. |
author_facet | Jocham, Gerhard Brodersen, Kay H. Constantinescu, Alexandra O. Kahn, Martin C. Ianni, Angela M. Walton, Mark E. Rushworth, Matthew F.S. Behrens, Timothy E.J. |
author_sort | Jocham, Gerhard |
collection | PubMed |
description | When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task. |
format | Online Article Text |
id | pubmed-4826429 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2016 |
publisher | Cell Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-48264292016-04-20 Reward-Guided Learning with and without Causal Attribution Jocham, Gerhard Brodersen, Kay H. Constantinescu, Alexandra O. Kahn, Martin C. Ianni, Angela M. Walton, Mark E. Rushworth, Matthew F.S. Behrens, Timothy E.J. Neuron Article When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task. Cell Press 2016-04-06 /pmc/articles/PMC4826429/ /pubmed/26971947 http://dx.doi.org/10.1016/j.neuron.2016.02.018 Text en © 2016 The Authors http://creativecommons.org/licenses/by/4.0/ This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Jocham, Gerhard Brodersen, Kay H. Constantinescu, Alexandra O. Kahn, Martin C. Ianni, Angela M. Walton, Mark E. Rushworth, Matthew F.S. Behrens, Timothy E.J. Reward-Guided Learning with and without Causal Attribution |
title | Reward-Guided Learning with and without Causal Attribution |
title_full | Reward-Guided Learning with and without Causal Attribution |
title_fullStr | Reward-Guided Learning with and without Causal Attribution |
title_full_unstemmed | Reward-Guided Learning with and without Causal Attribution |
title_short | Reward-Guided Learning with and without Causal Attribution |
title_sort | reward-guided learning with and without causal attribution |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4826429/ https://www.ncbi.nlm.nih.gov/pubmed/26971947 http://dx.doi.org/10.1016/j.neuron.2016.02.018 |
work_keys_str_mv | AT jochamgerhard rewardguidedlearningwithandwithoutcausalattribution AT brodersenkayh rewardguidedlearningwithandwithoutcausalattribution AT constantinescualexandrao rewardguidedlearningwithandwithoutcausalattribution AT kahnmartinc rewardguidedlearningwithandwithoutcausalattribution AT ianniangelam rewardguidedlearningwithandwithoutcausalattribution AT waltonmarke rewardguidedlearningwithandwithoutcausalattribution AT rushworthmatthewfs rewardguidedlearningwithandwithoutcausalattribution AT behrenstimothyej rewardguidedlearningwithandwithoutcausalattribution |