Cargando…

Automated curriculum learning for embodied agents a neuroevolutionary approach

We demonstrate how the evolutionary training of embodied agents can be extended with a curriculum learning algorithm that automatically selects the environmental conditions in which the evolving agents are evaluated. The environmental conditions are selected to adjust the level of difficulty to the...

Descripción completa

Detalles Bibliográficos
Autores principales: Milano, Nicola, Nolfi, Stefano
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8076209/
https://www.ncbi.nlm.nih.gov/pubmed/33903698
http://dx.doi.org/10.1038/s41598-021-88464-5
_version_ 1783684648683962368
author Milano, Nicola
Nolfi, Stefano
author_facet Milano, Nicola
Nolfi, Stefano
author_sort Milano, Nicola
collection PubMed
description We demonstrate how the evolutionary training of embodied agents can be extended with a curriculum learning algorithm that automatically selects the environmental conditions in which the evolving agents are evaluated. The environmental conditions are selected to adjust the level of difficulty to the ability level of the current evolving agents, and to challenge the weaknesses of the evolving agents. The method does not require domain knowledge and does not introduce additional hyperparameters. The results collected on two benchmark problems, that require to solve a task in significantly varying environmental conditions, demonstrate that the method proposed outperforms conventional learning methods and generates solutions which are robust to variations and able to cope with different environmental conditions.
format Online
Article
Text
id pubmed-8076209
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-80762092021-04-27 Automated curriculum learning for embodied agents a neuroevolutionary approach Milano, Nicola Nolfi, Stefano Sci Rep Article We demonstrate how the evolutionary training of embodied agents can be extended with a curriculum learning algorithm that automatically selects the environmental conditions in which the evolving agents are evaluated. The environmental conditions are selected to adjust the level of difficulty to the ability level of the current evolving agents, and to challenge the weaknesses of the evolving agents. The method does not require domain knowledge and does not introduce additional hyperparameters. The results collected on two benchmark problems, that require to solve a task in significantly varying environmental conditions, demonstrate that the method proposed outperforms conventional learning methods and generates solutions which are robust to variations and able to cope with different environmental conditions. Nature Publishing Group UK 2021-04-26 /pmc/articles/PMC8076209/ /pubmed/33903698 http://dx.doi.org/10.1038/s41598-021-88464-5 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Milano, Nicola
Nolfi, Stefano
Automated curriculum learning for embodied agents a neuroevolutionary approach
title Automated curriculum learning for embodied agents a neuroevolutionary approach
title_full Automated curriculum learning for embodied agents a neuroevolutionary approach
title_fullStr Automated curriculum learning for embodied agents a neuroevolutionary approach
title_full_unstemmed Automated curriculum learning for embodied agents a neuroevolutionary approach
title_short Automated curriculum learning for embodied agents a neuroevolutionary approach
title_sort automated curriculum learning for embodied agents a neuroevolutionary approach
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8076209/
https://www.ncbi.nlm.nih.gov/pubmed/33903698
http://dx.doi.org/10.1038/s41598-021-88464-5
work_keys_str_mv AT milanonicola automatedcurriculumlearningforembodiedagentsaneuroevolutionaryapproach
AT nolfistefano automatedcurriculumlearningforembodiedagentsaneuroevolutionaryapproach