Cargando…

Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales

Dopamine has long been tightly associated with aspects of reinforcement learning and motivation in simple situations where there are a limited number of stimuli to guide behavior and constrained range of outcomes. In naturalistic situations, however, there are many potential cues and foraging strate...

Descripción completa

Detalles Bibliográficos
Autores principales: Baudonnat, Mathieu, Huber, Anna, David, Vincent, Walton, Mark E.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2013
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3795326/
https://www.ncbi.nlm.nih.gov/pubmed/24130514
http://dx.doi.org/10.3389/fnins.2013.00175
_version_ 1782287362710044672
author Baudonnat, Mathieu
Huber, Anna
David, Vincent
Walton, Mark E.
author_facet Baudonnat, Mathieu
Huber, Anna
David, Vincent
Walton, Mark E.
author_sort Baudonnat, Mathieu
collection PubMed
description Dopamine has long been tightly associated with aspects of reinforcement learning and motivation in simple situations where there are a limited number of stimuli to guide behavior and constrained range of outcomes. In naturalistic situations, however, there are many potential cues and foraging strategies that could be adopted, and it is critical that animals determine what might be behaviorally relevant in such complex environments. This requires not only detecting discrepancies with what they have recently experienced, but also identifying similarities with past experiences stored in memory. Here, we review what role dopamine might play in determining how and when to learn about the world, and how to develop choice policies appropriate to the situation faced. We discuss evidence that dopamine is shaped by motivation and memory and in turn shapes reward-based memory formation. In particular, we suggest that hippocampal-striatal-dopamine networks may interact to determine how surprising the world is and to either inhibit or promote actions at time of behavioral uncertainty.
format Online
Article
Text
id pubmed-3795326
institution National Center for Biotechnology Information
language English
publishDate 2013
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-37953262013-10-15 Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales Baudonnat, Mathieu Huber, Anna David, Vincent Walton, Mark E. Front Neurosci Neuroscience Dopamine has long been tightly associated with aspects of reinforcement learning and motivation in simple situations where there are a limited number of stimuli to guide behavior and constrained range of outcomes. In naturalistic situations, however, there are many potential cues and foraging strategies that could be adopted, and it is critical that animals determine what might be behaviorally relevant in such complex environments. This requires not only detecting discrepancies with what they have recently experienced, but also identifying similarities with past experiences stored in memory. Here, we review what role dopamine might play in determining how and when to learn about the world, and how to develop choice policies appropriate to the situation faced. We discuss evidence that dopamine is shaped by motivation and memory and in turn shapes reward-based memory formation. In particular, we suggest that hippocampal-striatal-dopamine networks may interact to determine how surprising the world is and to either inhibit or promote actions at time of behavioral uncertainty. Frontiers Media S.A. 2013-10-11 /pmc/articles/PMC3795326/ /pubmed/24130514 http://dx.doi.org/10.3389/fnins.2013.00175 Text en Copyright © 2013 Baudonnat, Huber, David and Walton. http://creativecommons.org/licenses/by/3.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Baudonnat, Mathieu
Huber, Anna
David, Vincent
Walton, Mark E.
Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales
title Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales
title_full Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales
title_fullStr Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales
title_full_unstemmed Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales
title_short Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales
title_sort heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3795326/
https://www.ncbi.nlm.nih.gov/pubmed/24130514
http://dx.doi.org/10.3389/fnins.2013.00175
work_keys_str_mv AT baudonnatmathieu headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehavioralrelevanceacrossmultipletimescales
AT huberanna headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehavioralrelevanceacrossmultipletimescales
AT davidvincent headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehavioralrelevanceacrossmultipletimescales
AT waltonmarke headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehavioralrelevanceacrossmultipletimescales