Cargando…

Co-Evolution of Predator-Prey Ecosystems by Reinforcement Learning Agents

The problem of finding adequate population models in ecology is important for understanding essential aspects of their dynamic nature. Since analyzing and accurately predicting the intelligent adaptation of multiple species is difficult due to their complex interactions, the study of population dyna...

Descripción completa

Detalles Bibliográficos
Autores principales: Park, Jeongho, Lee, Juwon, Kim, Taehwan, Ahn, Inkyung, Park, Jooyoung
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8069842/
https://www.ncbi.nlm.nih.gov/pubmed/33924723
http://dx.doi.org/10.3390/e23040461
_version_ 1783683332024827904
author Park, Jeongho
Lee, Juwon
Kim, Taehwan
Ahn, Inkyung
Park, Jooyoung
author_facet Park, Jeongho
Lee, Juwon
Kim, Taehwan
Ahn, Inkyung
Park, Jooyoung
author_sort Park, Jeongho
collection PubMed
description The problem of finding adequate population models in ecology is important for understanding essential aspects of their dynamic nature. Since analyzing and accurately predicting the intelligent adaptation of multiple species is difficult due to their complex interactions, the study of population dynamics still remains a challenging task in computational biology. In this paper, we use a modern deep reinforcement learning (RL) approach to explore a new avenue for understanding predator-prey ecosystems. Recently, reinforcement learning methods have achieved impressive results in areas, such as games and robotics. RL agents generally focus on building strategies for taking actions in an environment in order to maximize their expected returns. Here we frame the co-evolution of predators and preys in an ecosystem as allowing agents to learn and evolve toward better ones in a manner appropriate for multi-agent reinforcement learning. Recent significant advancements in reinforcement learning allow for new perspectives on these types of ecological issues. Our simulation results show that throughout the scenarios with RL agents, predators can achieve a reasonable level of sustainability, along with their preys.
format Online
Article
Text
id pubmed-8069842
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-80698422021-04-26 Co-Evolution of Predator-Prey Ecosystems by Reinforcement Learning Agents Park, Jeongho Lee, Juwon Kim, Taehwan Ahn, Inkyung Park, Jooyoung Entropy (Basel) Article The problem of finding adequate population models in ecology is important for understanding essential aspects of their dynamic nature. Since analyzing and accurately predicting the intelligent adaptation of multiple species is difficult due to their complex interactions, the study of population dynamics still remains a challenging task in computational biology. In this paper, we use a modern deep reinforcement learning (RL) approach to explore a new avenue for understanding predator-prey ecosystems. Recently, reinforcement learning methods have achieved impressive results in areas, such as games and robotics. RL agents generally focus on building strategies for taking actions in an environment in order to maximize their expected returns. Here we frame the co-evolution of predators and preys in an ecosystem as allowing agents to learn and evolve toward better ones in a manner appropriate for multi-agent reinforcement learning. Recent significant advancements in reinforcement learning allow for new perspectives on these types of ecological issues. Our simulation results show that throughout the scenarios with RL agents, predators can achieve a reasonable level of sustainability, along with their preys. MDPI 2021-04-13 /pmc/articles/PMC8069842/ /pubmed/33924723 http://dx.doi.org/10.3390/e23040461 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Park, Jeongho
Lee, Juwon
Kim, Taehwan
Ahn, Inkyung
Park, Jooyoung
Co-Evolution of Predator-Prey Ecosystems by Reinforcement Learning Agents
title Co-Evolution of Predator-Prey Ecosystems by Reinforcement Learning Agents
title_full Co-Evolution of Predator-Prey Ecosystems by Reinforcement Learning Agents
title_fullStr Co-Evolution of Predator-Prey Ecosystems by Reinforcement Learning Agents
title_full_unstemmed Co-Evolution of Predator-Prey Ecosystems by Reinforcement Learning Agents
title_short Co-Evolution of Predator-Prey Ecosystems by Reinforcement Learning Agents
title_sort co-evolution of predator-prey ecosystems by reinforcement learning agents
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8069842/
https://www.ncbi.nlm.nih.gov/pubmed/33924723
http://dx.doi.org/10.3390/e23040461
work_keys_str_mv AT parkjeongho coevolutionofpredatorpreyecosystemsbyreinforcementlearningagents
AT leejuwon coevolutionofpredatorpreyecosystemsbyreinforcementlearningagents
AT kimtaehwan coevolutionofpredatorpreyecosystemsbyreinforcementlearningagents
AT ahninkyung coevolutionofpredatorpreyecosystemsbyreinforcementlearningagents
AT parkjooyoung coevolutionofpredatorpreyecosystemsbyreinforcementlearningagents