Cargando…
Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding
Hard-wired, Pavlovian, responses elicited by predictions of rewards and punishments exert significant benevolent and malevolent influences over instrumentally-appropriate actions. These influences come in two main groups, defined along anatomical, pharmacological, behavioural and functional lines. I...
Autores principales: | , , , , , , |
---|---|
Formato: | Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2011
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3080848/ https://www.ncbi.nlm.nih.gov/pubmed/21556131 http://dx.doi.org/10.1371/journal.pcbi.1002028 |
_version_ | 1782202151611662336 |
---|---|
author | Huys, Quentin J. M. Cools, Roshan Gölzer, Martin Friedel, Eva Heinz, Andreas Dolan, Raymond J. Dayan, Peter |
author_facet | Huys, Quentin J. M. Cools, Roshan Gölzer, Martin Friedel, Eva Heinz, Andreas Dolan, Raymond J. Dayan, Peter |
author_sort | Huys, Quentin J. M. |
collection | PubMed |
description | Hard-wired, Pavlovian, responses elicited by predictions of rewards and punishments exert significant benevolent and malevolent influences over instrumentally-appropriate actions. These influences come in two main groups, defined along anatomical, pharmacological, behavioural and functional lines. Investigations of the influences have so far concentrated on the groups as a whole; here we take the critical step of looking inside each group, using a detailed reinforcement learning model to distinguish effects to do with value, specific actions, and general activation or inhibition. We show a high degree of sophistication in Pavlovian influences, with appetitive Pavlovian stimuli specifically promoting approach and inhibiting withdrawal, and aversive Pavlovian stimuli promoting withdrawal and inhibiting approach. These influences account for differences in the instrumental performance of approach and withdrawal behaviours. Finally, although losses are as informative as gains, we find that subjects neglect losses in their instrumental learning. Our findings argue for a view of the Pavlovian system as a constraint or prior, facilitating learning by alleviating computational costs that come with increased flexibility. |
format | Text |
id | pubmed-3080848 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2011 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-30808482011-05-09 Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding Huys, Quentin J. M. Cools, Roshan Gölzer, Martin Friedel, Eva Heinz, Andreas Dolan, Raymond J. Dayan, Peter PLoS Comput Biol Research Article Hard-wired, Pavlovian, responses elicited by predictions of rewards and punishments exert significant benevolent and malevolent influences over instrumentally-appropriate actions. These influences come in two main groups, defined along anatomical, pharmacological, behavioural and functional lines. Investigations of the influences have so far concentrated on the groups as a whole; here we take the critical step of looking inside each group, using a detailed reinforcement learning model to distinguish effects to do with value, specific actions, and general activation or inhibition. We show a high degree of sophistication in Pavlovian influences, with appetitive Pavlovian stimuli specifically promoting approach and inhibiting withdrawal, and aversive Pavlovian stimuli promoting withdrawal and inhibiting approach. These influences account for differences in the instrumental performance of approach and withdrawal behaviours. Finally, although losses are as informative as gains, we find that subjects neglect losses in their instrumental learning. Our findings argue for a view of the Pavlovian system as a constraint or prior, facilitating learning by alleviating computational costs that come with increased flexibility. Public Library of Science 2011-04-21 /pmc/articles/PMC3080848/ /pubmed/21556131 http://dx.doi.org/10.1371/journal.pcbi.1002028 Text en Huys et al. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited. |
spellingShingle | Research Article Huys, Quentin J. M. Cools, Roshan Gölzer, Martin Friedel, Eva Heinz, Andreas Dolan, Raymond J. Dayan, Peter Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding |
title | Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding |
title_full | Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding |
title_fullStr | Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding |
title_full_unstemmed | Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding |
title_short | Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding |
title_sort | disentangling the roles of approach, activation and valence in instrumental and pavlovian responding |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3080848/ https://www.ncbi.nlm.nih.gov/pubmed/21556131 http://dx.doi.org/10.1371/journal.pcbi.1002028 |
work_keys_str_mv | AT huysquentinjm disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding AT coolsroshan disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding AT golzermartin disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding AT friedeleva disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding AT heinzandreas disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding AT dolanraymondj disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding AT dayanpeter disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding |