Cargando…
Hippocampal pattern separation supports reinforcement learning
Animals rely on learned associations to make decisions. Associations can be based on relationships between object features (e.g., the three leaflets of poison ivy leaves) and outcomes (e.g., rash). More often, outcomes are linked to multidimensional states (e.g., poison ivy is green in summer but re...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6403348/ https://www.ncbi.nlm.nih.gov/pubmed/30842581 http://dx.doi.org/10.1038/s41467-019-08998-1 |
_version_ | 1783400579363504128 |
---|---|
author | Ballard, Ian C. Wagner, Anthony D. McClure, Samuel M. |
author_facet | Ballard, Ian C. Wagner, Anthony D. McClure, Samuel M. |
author_sort | Ballard, Ian C. |
collection | PubMed |
description | Animals rely on learned associations to make decisions. Associations can be based on relationships between object features (e.g., the three leaflets of poison ivy leaves) and outcomes (e.g., rash). More often, outcomes are linked to multidimensional states (e.g., poison ivy is green in summer but red in spring). Feature-based reinforcement learning fails when the values of individual features depend on the other features present. One solution is to assign value to multi-featural conjunctive representations. Here, we test if the hippocampus forms separable conjunctive representations that enables the learning of response contingencies for stimuli of the form: AB+, B−, AC−, C+. Pattern analyses on functional MRI data show the hippocampus forms conjunctive representations that are dissociable from feature components and that these representations, along with those of cortex, influence striatal prediction errors. Our results establish a novel role for hippocampal pattern separation and conjunctive representation in reinforcement learning. |
format | Online Article Text |
id | pubmed-6403348 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-64033482019-03-08 Hippocampal pattern separation supports reinforcement learning Ballard, Ian C. Wagner, Anthony D. McClure, Samuel M. Nat Commun Article Animals rely on learned associations to make decisions. Associations can be based on relationships between object features (e.g., the three leaflets of poison ivy leaves) and outcomes (e.g., rash). More often, outcomes are linked to multidimensional states (e.g., poison ivy is green in summer but red in spring). Feature-based reinforcement learning fails when the values of individual features depend on the other features present. One solution is to assign value to multi-featural conjunctive representations. Here, we test if the hippocampus forms separable conjunctive representations that enables the learning of response contingencies for stimuli of the form: AB+, B−, AC−, C+. Pattern analyses on functional MRI data show the hippocampus forms conjunctive representations that are dissociable from feature components and that these representations, along with those of cortex, influence striatal prediction errors. Our results establish a novel role for hippocampal pattern separation and conjunctive representation in reinforcement learning. Nature Publishing Group UK 2019-03-06 /pmc/articles/PMC6403348/ /pubmed/30842581 http://dx.doi.org/10.1038/s41467-019-08998-1 Text en © The Author(s) 2019 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Ballard, Ian C. Wagner, Anthony D. McClure, Samuel M. Hippocampal pattern separation supports reinforcement learning |
title | Hippocampal pattern separation supports reinforcement learning |
title_full | Hippocampal pattern separation supports reinforcement learning |
title_fullStr | Hippocampal pattern separation supports reinforcement learning |
title_full_unstemmed | Hippocampal pattern separation supports reinforcement learning |
title_short | Hippocampal pattern separation supports reinforcement learning |
title_sort | hippocampal pattern separation supports reinforcement learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6403348/ https://www.ncbi.nlm.nih.gov/pubmed/30842581 http://dx.doi.org/10.1038/s41467-019-08998-1 |
work_keys_str_mv | AT ballardianc hippocampalpatternseparationsupportsreinforcementlearning AT wagneranthonyd hippocampalpatternseparationsupportsreinforcementlearning AT mccluresamuelm hippocampalpatternseparationsupportsreinforcementlearning |