Cargando…

Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding

Hard-wired, Pavlovian, responses elicited by predictions of rewards and punishments exert significant benevolent and malevolent influences over instrumentally-appropriate actions. These influences come in two main groups, defined along anatomical, pharmacological, behavioural and functional lines. I...

Descripción completa

Detalles Bibliográficos
Autores principales: Huys, Quentin J. M., Cools, Roshan, Gölzer, Martin, Friedel, Eva, Heinz, Andreas, Dolan, Raymond J., Dayan, Peter
Formato: Texto
Lenguaje:English
Publicado: Public Library of Science 2011
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3080848/
https://www.ncbi.nlm.nih.gov/pubmed/21556131
http://dx.doi.org/10.1371/journal.pcbi.1002028
_version_ 1782202151611662336
author Huys, Quentin J. M.
Cools, Roshan
Gölzer, Martin
Friedel, Eva
Heinz, Andreas
Dolan, Raymond J.
Dayan, Peter
author_facet Huys, Quentin J. M.
Cools, Roshan
Gölzer, Martin
Friedel, Eva
Heinz, Andreas
Dolan, Raymond J.
Dayan, Peter
author_sort Huys, Quentin J. M.
collection PubMed
description Hard-wired, Pavlovian, responses elicited by predictions of rewards and punishments exert significant benevolent and malevolent influences over instrumentally-appropriate actions. These influences come in two main groups, defined along anatomical, pharmacological, behavioural and functional lines. Investigations of the influences have so far concentrated on the groups as a whole; here we take the critical step of looking inside each group, using a detailed reinforcement learning model to distinguish effects to do with value, specific actions, and general activation or inhibition. We show a high degree of sophistication in Pavlovian influences, with appetitive Pavlovian stimuli specifically promoting approach and inhibiting withdrawal, and aversive Pavlovian stimuli promoting withdrawal and inhibiting approach. These influences account for differences in the instrumental performance of approach and withdrawal behaviours. Finally, although losses are as informative as gains, we find that subjects neglect losses in their instrumental learning. Our findings argue for a view of the Pavlovian system as a constraint or prior, facilitating learning by alleviating computational costs that come with increased flexibility.
format Text
id pubmed-3080848
institution National Center for Biotechnology Information
language English
publishDate 2011
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-30808482011-05-09 Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding Huys, Quentin J. M. Cools, Roshan Gölzer, Martin Friedel, Eva Heinz, Andreas Dolan, Raymond J. Dayan, Peter PLoS Comput Biol Research Article Hard-wired, Pavlovian, responses elicited by predictions of rewards and punishments exert significant benevolent and malevolent influences over instrumentally-appropriate actions. These influences come in two main groups, defined along anatomical, pharmacological, behavioural and functional lines. Investigations of the influences have so far concentrated on the groups as a whole; here we take the critical step of looking inside each group, using a detailed reinforcement learning model to distinguish effects to do with value, specific actions, and general activation or inhibition. We show a high degree of sophistication in Pavlovian influences, with appetitive Pavlovian stimuli specifically promoting approach and inhibiting withdrawal, and aversive Pavlovian stimuli promoting withdrawal and inhibiting approach. These influences account for differences in the instrumental performance of approach and withdrawal behaviours. Finally, although losses are as informative as gains, we find that subjects neglect losses in their instrumental learning. Our findings argue for a view of the Pavlovian system as a constraint or prior, facilitating learning by alleviating computational costs that come with increased flexibility. Public Library of Science 2011-04-21 /pmc/articles/PMC3080848/ /pubmed/21556131 http://dx.doi.org/10.1371/journal.pcbi.1002028 Text en Huys et al. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
spellingShingle Research Article
Huys, Quentin J. M.
Cools, Roshan
Gölzer, Martin
Friedel, Eva
Heinz, Andreas
Dolan, Raymond J.
Dayan, Peter
Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding
title Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding
title_full Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding
title_fullStr Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding
title_full_unstemmed Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding
title_short Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding
title_sort disentangling the roles of approach, activation and valence in instrumental and pavlovian responding
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3080848/
https://www.ncbi.nlm.nih.gov/pubmed/21556131
http://dx.doi.org/10.1371/journal.pcbi.1002028
work_keys_str_mv AT huysquentinjm disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding
AT coolsroshan disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding
AT golzermartin disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding
AT friedeleva disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding
AT heinzandreas disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding
AT dolanraymondj disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding
AT dayanpeter disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding