Cargando…

Hippocampal pattern separation supports reinforcement learning

Animals rely on learned associations to make decisions. Associations can be based on relationships between object features (e.g., the three leaflets of poison ivy leaves) and outcomes (e.g., rash). More often, outcomes are linked to multidimensional states (e.g., poison ivy is green in summer but re...

Descripción completa

Detalles Bibliográficos
Autores principales: Ballard, Ian C., Wagner, Anthony D., McClure, Samuel M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6403348/
https://www.ncbi.nlm.nih.gov/pubmed/30842581
http://dx.doi.org/10.1038/s41467-019-08998-1
_version_ 1783400579363504128
author Ballard, Ian C.
Wagner, Anthony D.
McClure, Samuel M.
author_facet Ballard, Ian C.
Wagner, Anthony D.
McClure, Samuel M.
author_sort Ballard, Ian C.
collection PubMed
description Animals rely on learned associations to make decisions. Associations can be based on relationships between object features (e.g., the three leaflets of poison ivy leaves) and outcomes (e.g., rash). More often, outcomes are linked to multidimensional states (e.g., poison ivy is green in summer but red in spring). Feature-based reinforcement learning fails when the values of individual features depend on the other features present. One solution is to assign value to multi-featural conjunctive representations. Here, we test if the hippocampus forms separable conjunctive representations that enables the learning of response contingencies for stimuli of the form: AB+, B−, AC−, C+. Pattern analyses on functional MRI data show the hippocampus forms conjunctive representations that are dissociable from feature components and that these representations, along with those of cortex, influence striatal prediction errors. Our results establish a novel role for hippocampal pattern separation and conjunctive representation in reinforcement learning.
format Online
Article
Text
id pubmed-6403348
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-64033482019-03-08 Hippocampal pattern separation supports reinforcement learning Ballard, Ian C. Wagner, Anthony D. McClure, Samuel M. Nat Commun Article Animals rely on learned associations to make decisions. Associations can be based on relationships between object features (e.g., the three leaflets of poison ivy leaves) and outcomes (e.g., rash). More often, outcomes are linked to multidimensional states (e.g., poison ivy is green in summer but red in spring). Feature-based reinforcement learning fails when the values of individual features depend on the other features present. One solution is to assign value to multi-featural conjunctive representations. Here, we test if the hippocampus forms separable conjunctive representations that enables the learning of response contingencies for stimuli of the form: AB+, B−, AC−, C+. Pattern analyses on functional MRI data show the hippocampus forms conjunctive representations that are dissociable from feature components and that these representations, along with those of cortex, influence striatal prediction errors. Our results establish a novel role for hippocampal pattern separation and conjunctive representation in reinforcement learning. Nature Publishing Group UK 2019-03-06 /pmc/articles/PMC6403348/ /pubmed/30842581 http://dx.doi.org/10.1038/s41467-019-08998-1 Text en © The Author(s) 2019 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Ballard, Ian C.
Wagner, Anthony D.
McClure, Samuel M.
Hippocampal pattern separation supports reinforcement learning
title Hippocampal pattern separation supports reinforcement learning
title_full Hippocampal pattern separation supports reinforcement learning
title_fullStr Hippocampal pattern separation supports reinforcement learning
title_full_unstemmed Hippocampal pattern separation supports reinforcement learning
title_short Hippocampal pattern separation supports reinforcement learning
title_sort hippocampal pattern separation supports reinforcement learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6403348/
https://www.ncbi.nlm.nih.gov/pubmed/30842581
http://dx.doi.org/10.1038/s41467-019-08998-1
work_keys_str_mv AT ballardianc hippocampalpatternseparationsupportsreinforcementlearning
AT wagneranthonyd hippocampalpatternseparationsupportsreinforcementlearning
AT mccluresamuelm hippocampalpatternseparationsupportsreinforcementlearning