Cargando…
Bayesian Cue Integration as a Developmental Outcome of Reward Mediated Learning
Average human behavior in cue combination tasks is well predicted by Bayesian inference models. As this capability is acquired over developmental timescales, the question arises, how it is learned. Here we investigated whether reward dependent learning, that is well established at the computational,...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2011
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3130032/ https://www.ncbi.nlm.nih.gov/pubmed/21750717 http://dx.doi.org/10.1371/journal.pone.0021575 |
_version_ | 1782207576623022080 |
---|---|
author | Weisswange, Thomas H. Rothkopf, Constantin A. Rodemann, Tobias Triesch, Jochen |
author_facet | Weisswange, Thomas H. Rothkopf, Constantin A. Rodemann, Tobias Triesch, Jochen |
author_sort | Weisswange, Thomas H. |
collection | PubMed |
description | Average human behavior in cue combination tasks is well predicted by Bayesian inference models. As this capability is acquired over developmental timescales, the question arises, how it is learned. Here we investigated whether reward dependent learning, that is well established at the computational, behavioral, and neuronal levels, could contribute to this development. It is shown that a model free reinforcement learning algorithm can indeed learn to do cue integration, i.e. weight uncertain cues according to their respective reliabilities and even do so if reliabilities are changing. We also consider the case of causal inference where multimodal signals can originate from one or multiple separate objects and should not always be integrated. In this case, the learner is shown to develop a behavior that is closest to Bayesian model averaging. We conclude that reward mediated learning could be a driving force for the development of cue integration and causal inference. |
format | Online Article Text |
id | pubmed-3130032 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2011 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-31300322011-07-12 Bayesian Cue Integration as a Developmental Outcome of Reward Mediated Learning Weisswange, Thomas H. Rothkopf, Constantin A. Rodemann, Tobias Triesch, Jochen PLoS One Research Article Average human behavior in cue combination tasks is well predicted by Bayesian inference models. As this capability is acquired over developmental timescales, the question arises, how it is learned. Here we investigated whether reward dependent learning, that is well established at the computational, behavioral, and neuronal levels, could contribute to this development. It is shown that a model free reinforcement learning algorithm can indeed learn to do cue integration, i.e. weight uncertain cues according to their respective reliabilities and even do so if reliabilities are changing. We also consider the case of causal inference where multimodal signals can originate from one or multiple separate objects and should not always be integrated. In this case, the learner is shown to develop a behavior that is closest to Bayesian model averaging. We conclude that reward mediated learning could be a driving force for the development of cue integration and causal inference. Public Library of Science 2011-07-05 /pmc/articles/PMC3130032/ /pubmed/21750717 http://dx.doi.org/10.1371/journal.pone.0021575 Text en Weisswange et al. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited. |
spellingShingle | Research Article Weisswange, Thomas H. Rothkopf, Constantin A. Rodemann, Tobias Triesch, Jochen Bayesian Cue Integration as a Developmental Outcome of Reward Mediated Learning |
title | Bayesian Cue Integration as a Developmental Outcome of Reward Mediated Learning |
title_full | Bayesian Cue Integration as a Developmental Outcome of Reward Mediated Learning |
title_fullStr | Bayesian Cue Integration as a Developmental Outcome of Reward Mediated Learning |
title_full_unstemmed | Bayesian Cue Integration as a Developmental Outcome of Reward Mediated Learning |
title_short | Bayesian Cue Integration as a Developmental Outcome of Reward Mediated Learning |
title_sort | bayesian cue integration as a developmental outcome of reward mediated learning |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3130032/ https://www.ncbi.nlm.nih.gov/pubmed/21750717 http://dx.doi.org/10.1371/journal.pone.0021575 |
work_keys_str_mv | AT weisswangethomash bayesiancueintegrationasadevelopmentaloutcomeofrewardmediatedlearning AT rothkopfconstantina bayesiancueintegrationasadevelopmentaloutcomeofrewardmediatedlearning AT rodemanntobias bayesiancueintegrationasadevelopmentaloutcomeofrewardmediatedlearning AT trieschjochen bayesiancueintegrationasadevelopmentaloutcomeofrewardmediatedlearning |