Cargando…

Stochastic evolution in populations of ideas

It is known that learning of players who interact in a repeated game can be interpreted as an evolutionary process in a population of ideas. These analogies have so far mostly been established in deterministic models, and memory loss in learning has been seen to act similarly to mutation in evolutio...

Descripción completa

Detalles Bibliográficos
Autores principales: Nicole, Robin, Sollich, Peter, Galla, Tobias
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5241820/
https://www.ncbi.nlm.nih.gov/pubmed/28098244
http://dx.doi.org/10.1038/srep40580
_version_ 1782496244121206784
author Nicole, Robin
Sollich, Peter
Galla, Tobias
author_facet Nicole, Robin
Sollich, Peter
Galla, Tobias
author_sort Nicole, Robin
collection PubMed
description It is known that learning of players who interact in a repeated game can be interpreted as an evolutionary process in a population of ideas. These analogies have so far mostly been established in deterministic models, and memory loss in learning has been seen to act similarly to mutation in evolution. We here propose a representation of reinforcement learning as a stochastic process in finite ‘populations of ideas’. The resulting birth-death dynamics has absorbing states and allows for the extinction or fixation of ideas, marking a key difference to mutation-selection processes in finite populations. We characterize the outcome of evolution in populations of ideas for several classes of symmetric and asymmetric games.
format Online
Article
Text
id pubmed-5241820
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher Nature Publishing Group
record_format MEDLINE/PubMed
spelling pubmed-52418202017-01-23 Stochastic evolution in populations of ideas Nicole, Robin Sollich, Peter Galla, Tobias Sci Rep Article It is known that learning of players who interact in a repeated game can be interpreted as an evolutionary process in a population of ideas. These analogies have so far mostly been established in deterministic models, and memory loss in learning has been seen to act similarly to mutation in evolution. We here propose a representation of reinforcement learning as a stochastic process in finite ‘populations of ideas’. The resulting birth-death dynamics has absorbing states and allows for the extinction or fixation of ideas, marking a key difference to mutation-selection processes in finite populations. We characterize the outcome of evolution in populations of ideas for several classes of symmetric and asymmetric games. Nature Publishing Group 2017-01-18 /pmc/articles/PMC5241820/ /pubmed/28098244 http://dx.doi.org/10.1038/srep40580 Text en Copyright © 2017, The Author(s) http://creativecommons.org/licenses/by/4.0/ This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
spellingShingle Article
Nicole, Robin
Sollich, Peter
Galla, Tobias
Stochastic evolution in populations of ideas
title Stochastic evolution in populations of ideas
title_full Stochastic evolution in populations of ideas
title_fullStr Stochastic evolution in populations of ideas
title_full_unstemmed Stochastic evolution in populations of ideas
title_short Stochastic evolution in populations of ideas
title_sort stochastic evolution in populations of ideas
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5241820/
https://www.ncbi.nlm.nih.gov/pubmed/28098244
http://dx.doi.org/10.1038/srep40580
work_keys_str_mv AT nicolerobin stochasticevolutioninpopulationsofideas
AT sollichpeter stochasticevolutioninpopulationsofideas
AT gallatobias stochasticevolutioninpopulationsofideas