Cargando…
Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales
Dopamine has long been tightly associated with aspects of reinforcement learning and motivation in simple situations where there are a limited number of stimuli to guide behavior and constrained range of outcomes. In naturalistic situations, however, there are many potential cues and foraging strate...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2013
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3795326/ https://www.ncbi.nlm.nih.gov/pubmed/24130514 http://dx.doi.org/10.3389/fnins.2013.00175 |
_version_ | 1782287362710044672 |
---|---|
author | Baudonnat, Mathieu Huber, Anna David, Vincent Walton, Mark E. |
author_facet | Baudonnat, Mathieu Huber, Anna David, Vincent Walton, Mark E. |
author_sort | Baudonnat, Mathieu |
collection | PubMed |
description | Dopamine has long been tightly associated with aspects of reinforcement learning and motivation in simple situations where there are a limited number of stimuli to guide behavior and constrained range of outcomes. In naturalistic situations, however, there are many potential cues and foraging strategies that could be adopted, and it is critical that animals determine what might be behaviorally relevant in such complex environments. This requires not only detecting discrepancies with what they have recently experienced, but also identifying similarities with past experiences stored in memory. Here, we review what role dopamine might play in determining how and when to learn about the world, and how to develop choice policies appropriate to the situation faced. We discuss evidence that dopamine is shaped by motivation and memory and in turn shapes reward-based memory formation. In particular, we suggest that hippocampal-striatal-dopamine networks may interact to determine how surprising the world is and to either inhibit or promote actions at time of behavioral uncertainty. |
format | Online Article Text |
id | pubmed-3795326 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2013 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-37953262013-10-15 Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales Baudonnat, Mathieu Huber, Anna David, Vincent Walton, Mark E. Front Neurosci Neuroscience Dopamine has long been tightly associated with aspects of reinforcement learning and motivation in simple situations where there are a limited number of stimuli to guide behavior and constrained range of outcomes. In naturalistic situations, however, there are many potential cues and foraging strategies that could be adopted, and it is critical that animals determine what might be behaviorally relevant in such complex environments. This requires not only detecting discrepancies with what they have recently experienced, but also identifying similarities with past experiences stored in memory. Here, we review what role dopamine might play in determining how and when to learn about the world, and how to develop choice policies appropriate to the situation faced. We discuss evidence that dopamine is shaped by motivation and memory and in turn shapes reward-based memory formation. In particular, we suggest that hippocampal-striatal-dopamine networks may interact to determine how surprising the world is and to either inhibit or promote actions at time of behavioral uncertainty. Frontiers Media S.A. 2013-10-11 /pmc/articles/PMC3795326/ /pubmed/24130514 http://dx.doi.org/10.3389/fnins.2013.00175 Text en Copyright © 2013 Baudonnat, Huber, David and Walton. http://creativecommons.org/licenses/by/3.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Baudonnat, Mathieu Huber, Anna David, Vincent Walton, Mark E. Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales |
title | Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales |
title_full | Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales |
title_fullStr | Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales |
title_full_unstemmed | Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales |
title_short | Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales |
title_sort | heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3795326/ https://www.ncbi.nlm.nih.gov/pubmed/24130514 http://dx.doi.org/10.3389/fnins.2013.00175 |
work_keys_str_mv | AT baudonnatmathieu headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehavioralrelevanceacrossmultipletimescales AT huberanna headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehavioralrelevanceacrossmultipletimescales AT davidvincent headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehavioralrelevanceacrossmultipletimescales AT waltonmarke headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehavioralrelevanceacrossmultipletimescales |