Cargando…

Sensitivity to outcome devaluation in operant tasks is better predicted by food restriction level than reinforcement training schedule in mice

Behavioral strategies are often classified based on whether reinforcement is controlled by the value of the reinforcer. Value-sensitive behaviors, in which animals update their actions when reinforcer value is changed, are classified as goal-directed; conversely, value-insensitive actions, where beh...

Descripción completa

Detalles Bibliográficos
Autores principales: Chevée, Maxime, Kim, Courtney J., Crow, Nevin, Follman, Emma G., Calipari, Erin S.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cold Spring Harbor Laboratory 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9980049/
https://www.ncbi.nlm.nih.gov/pubmed/36865193
http://dx.doi.org/10.1101/2023.02.23.529699
_version_ 1784899841792409600
author Chevée, Maxime
Kim, Courtney J.
Crow, Nevin
Follman, Emma G.
Calipari, Erin S.
author_facet Chevée, Maxime
Kim, Courtney J.
Crow, Nevin
Follman, Emma G.
Calipari, Erin S.
author_sort Chevée, Maxime
collection PubMed
description Behavioral strategies are often classified based on whether reinforcement is controlled by the value of the reinforcer. Value-sensitive behaviors, in which animals update their actions when reinforcer value is changed, are classified as goal-directed; conversely, value-insensitive actions, where behavior remains consistent when the reinforcer is removed or devalued, are considered habitual. Understanding the features of operant training that bias behavioral control toward either strategy is essential to understanding the cognitive and neuronal processes on which they rely. Using basic reinforcement principles, behavior can be biased toward relying on either process: random ratio (RR) schedules are thought to promote the formation of goal-directed behaviors while random intervals (RI) promote habitual control. However, how the schedule-specific features of these task structures relate to external factors to influence behavior is not well understood. Using male and female mice on distinct food restriction levels, we trained each group on RR schedules with responses-per-reinforcer rates matched to their RI counterparts to control for differences in reinforcement rate. We determined that food restriction level has a stronger effect on the behavior of mice following RR schedules than mice following RI schedules and that food restriction better predicted sensitivity to outcome devaluation than training schedule. Our results support the idea the relationships between RR or RI schedules with goal-directed or habitual behaviors, respectively, are more nuanced than previously appreciated and suggest that an animal’s engagement in a task must be accounted for, together with the structure of reinforcement schedules, to appropriately interpret the cognitive underpinnings of behavior.
format Online
Article
Text
id pubmed-9980049
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Cold Spring Harbor Laboratory
record_format MEDLINE/PubMed
spelling pubmed-99800492023-03-03 Sensitivity to outcome devaluation in operant tasks is better predicted by food restriction level than reinforcement training schedule in mice Chevée, Maxime Kim, Courtney J. Crow, Nevin Follman, Emma G. Calipari, Erin S. bioRxiv Article Behavioral strategies are often classified based on whether reinforcement is controlled by the value of the reinforcer. Value-sensitive behaviors, in which animals update their actions when reinforcer value is changed, are classified as goal-directed; conversely, value-insensitive actions, where behavior remains consistent when the reinforcer is removed or devalued, are considered habitual. Understanding the features of operant training that bias behavioral control toward either strategy is essential to understanding the cognitive and neuronal processes on which they rely. Using basic reinforcement principles, behavior can be biased toward relying on either process: random ratio (RR) schedules are thought to promote the formation of goal-directed behaviors while random intervals (RI) promote habitual control. However, how the schedule-specific features of these task structures relate to external factors to influence behavior is not well understood. Using male and female mice on distinct food restriction levels, we trained each group on RR schedules with responses-per-reinforcer rates matched to their RI counterparts to control for differences in reinforcement rate. We determined that food restriction level has a stronger effect on the behavior of mice following RR schedules than mice following RI schedules and that food restriction better predicted sensitivity to outcome devaluation than training schedule. Our results support the idea the relationships between RR or RI schedules with goal-directed or habitual behaviors, respectively, are more nuanced than previously appreciated and suggest that an animal’s engagement in a task must be accounted for, together with the structure of reinforcement schedules, to appropriately interpret the cognitive underpinnings of behavior. Cold Spring Harbor Laboratory 2023-02-23 /pmc/articles/PMC9980049/ /pubmed/36865193 http://dx.doi.org/10.1101/2023.02.23.529699 Text en https://creativecommons.org/licenses/by-nc-nd/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (https://creativecommons.org/licenses/by-nc-nd/4.0/) , which allows reusers to copy and distribute the material in any medium or format in unadapted form only, for noncommercial purposes only, and only so long as attribution is given to the creator.
spellingShingle Article
Chevée, Maxime
Kim, Courtney J.
Crow, Nevin
Follman, Emma G.
Calipari, Erin S.
Sensitivity to outcome devaluation in operant tasks is better predicted by food restriction level than reinforcement training schedule in mice
title Sensitivity to outcome devaluation in operant tasks is better predicted by food restriction level than reinforcement training schedule in mice
title_full Sensitivity to outcome devaluation in operant tasks is better predicted by food restriction level than reinforcement training schedule in mice
title_fullStr Sensitivity to outcome devaluation in operant tasks is better predicted by food restriction level than reinforcement training schedule in mice
title_full_unstemmed Sensitivity to outcome devaluation in operant tasks is better predicted by food restriction level than reinforcement training schedule in mice
title_short Sensitivity to outcome devaluation in operant tasks is better predicted by food restriction level than reinforcement training schedule in mice
title_sort sensitivity to outcome devaluation in operant tasks is better predicted by food restriction level than reinforcement training schedule in mice
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9980049/
https://www.ncbi.nlm.nih.gov/pubmed/36865193
http://dx.doi.org/10.1101/2023.02.23.529699
work_keys_str_mv AT cheveemaxime sensitivitytooutcomedevaluationinoperanttasksisbetterpredictedbyfoodrestrictionlevelthanreinforcementtrainingscheduleinmice
AT kimcourtneyj sensitivitytooutcomedevaluationinoperanttasksisbetterpredictedbyfoodrestrictionlevelthanreinforcementtrainingscheduleinmice
AT crownevin sensitivitytooutcomedevaluationinoperanttasksisbetterpredictedbyfoodrestrictionlevelthanreinforcementtrainingscheduleinmice
AT follmanemmag sensitivitytooutcomedevaluationinoperanttasksisbetterpredictedbyfoodrestrictionlevelthanreinforcementtrainingscheduleinmice
AT caliparierins sensitivitytooutcomedevaluationinoperanttasksisbetterpredictedbyfoodrestrictionlevelthanreinforcementtrainingscheduleinmice