Cargando…

The Memory Trace Supporting Lose-Shift Responding Decays Rapidly after Reward Omission and Is Distinct from Other Learning Mechanisms in Rats

The propensity of animals to shift choices immediately after unexpectedly poor reinforcement outcomes is a pervasive strategy across species and tasks. We report here that the memory supporting such lose-shift responding in rats rapidly decays during the intertrial interval and persists throughout t...

Descripción completa

Detalles Bibliográficos
Autores principales: Gruber, Aaron J., Thapa, Rajat
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Society for Neuroscience 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5112541/
https://www.ncbi.nlm.nih.gov/pubmed/27896312
http://dx.doi.org/10.1523/ENEURO.0167-16.2016
_version_ 1782468020946337792
author Gruber, Aaron J.
Thapa, Rajat
author_facet Gruber, Aaron J.
Thapa, Rajat
author_sort Gruber, Aaron J.
collection PubMed
description The propensity of animals to shift choices immediately after unexpectedly poor reinforcement outcomes is a pervasive strategy across species and tasks. We report here that the memory supporting such lose-shift responding in rats rapidly decays during the intertrial interval and persists throughout training and testing on a binary choice task, despite being a suboptimal strategy. Lose-shift responding is not positively correlated with the prevalence and temporal dependence of win-stay responding, and it is inconsistent with predictions of reinforcement learning on the task. These data provide further evidence that win-stay and lose-shift are mediated by dissociated neural mechanisms and indicate that lose-shift responding presents a potential confound for the study of choice in the many operant choice tasks with short intertrial intervals. We propose that this immediate lose-shift responding is an intrinsic feature of the brain’s choice mechanisms that is engaged as a choice reflex and works in parallel with reinforcement learning and other control mechanisms to guide action selection.
format Online
Article
Text
id pubmed-5112541
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Society for Neuroscience
record_format MEDLINE/PubMed
spelling pubmed-51125412016-11-28 The Memory Trace Supporting Lose-Shift Responding Decays Rapidly after Reward Omission and Is Distinct from Other Learning Mechanisms in Rats Gruber, Aaron J. Thapa, Rajat eNeuro New Research The propensity of animals to shift choices immediately after unexpectedly poor reinforcement outcomes is a pervasive strategy across species and tasks. We report here that the memory supporting such lose-shift responding in rats rapidly decays during the intertrial interval and persists throughout training and testing on a binary choice task, despite being a suboptimal strategy. Lose-shift responding is not positively correlated with the prevalence and temporal dependence of win-stay responding, and it is inconsistent with predictions of reinforcement learning on the task. These data provide further evidence that win-stay and lose-shift are mediated by dissociated neural mechanisms and indicate that lose-shift responding presents a potential confound for the study of choice in the many operant choice tasks with short intertrial intervals. We propose that this immediate lose-shift responding is an intrinsic feature of the brain’s choice mechanisms that is engaged as a choice reflex and works in parallel with reinforcement learning and other control mechanisms to guide action selection. Society for Neuroscience 2016-11-17 /pmc/articles/PMC5112541/ /pubmed/27896312 http://dx.doi.org/10.1523/ENEURO.0167-16.2016 Text en Copyright © 2016 Gruber and Thapa http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution and reproduction in any medium provided that the original work is properly attributed.
spellingShingle New Research
Gruber, Aaron J.
Thapa, Rajat
The Memory Trace Supporting Lose-Shift Responding Decays Rapidly after Reward Omission and Is Distinct from Other Learning Mechanisms in Rats
title The Memory Trace Supporting Lose-Shift Responding Decays Rapidly after Reward Omission and Is Distinct from Other Learning Mechanisms in Rats
title_full The Memory Trace Supporting Lose-Shift Responding Decays Rapidly after Reward Omission and Is Distinct from Other Learning Mechanisms in Rats
title_fullStr The Memory Trace Supporting Lose-Shift Responding Decays Rapidly after Reward Omission and Is Distinct from Other Learning Mechanisms in Rats
title_full_unstemmed The Memory Trace Supporting Lose-Shift Responding Decays Rapidly after Reward Omission and Is Distinct from Other Learning Mechanisms in Rats
title_short The Memory Trace Supporting Lose-Shift Responding Decays Rapidly after Reward Omission and Is Distinct from Other Learning Mechanisms in Rats
title_sort memory trace supporting lose-shift responding decays rapidly after reward omission and is distinct from other learning mechanisms in rats
topic New Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5112541/
https://www.ncbi.nlm.nih.gov/pubmed/27896312
http://dx.doi.org/10.1523/ENEURO.0167-16.2016
work_keys_str_mv AT gruberaaronj thememorytracesupportingloseshiftrespondingdecaysrapidlyafterrewardomissionandisdistinctfromotherlearningmechanismsinrats
AT thaparajat thememorytracesupportingloseshiftrespondingdecaysrapidlyafterrewardomissionandisdistinctfromotherlearningmechanismsinrats
AT gruberaaronj memorytracesupportingloseshiftrespondingdecaysrapidlyafterrewardomissionandisdistinctfromotherlearningmechanismsinrats
AT thaparajat memorytracesupportingloseshiftrespondingdecaysrapidlyafterrewardomissionandisdistinctfromotherlearningmechanismsinrats