Cargando…
Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference
This study investigated how a physical robot can adapt goal-directed actions in dynamically changing environments, in real-time, using an active inference-based approach with incremental learning from human tutoring examples. Using our active inference-based model, while good generalization can be a...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10670890/ https://www.ncbi.nlm.nih.gov/pubmed/37998198 http://dx.doi.org/10.3390/e25111506 |
_version_ | 1785140025793445888 |
---|---|
author | Matsumoto, Takazumi Ohata, Wataru Tani, Jun |
author_facet | Matsumoto, Takazumi Ohata, Wataru Tani, Jun |
author_sort | Matsumoto, Takazumi |
collection | PubMed |
description | This study investigated how a physical robot can adapt goal-directed actions in dynamically changing environments, in real-time, using an active inference-based approach with incremental learning from human tutoring examples. Using our active inference-based model, while good generalization can be achieved with appropriate parameters, when faced with sudden, large changes in the environment, a human may have to intervene to correct actions of the robot in order to reach the goal, as a caregiver might guide the hands of a child performing an unfamiliar task. In order for the robot to learn from the human tutor, we propose a new scheme to accomplish incremental learning from these proprioceptive–exteroceptive experiences combined with mental rehearsal of past experiences. Our experimental results demonstrate that using only a few tutoring examples, the robot using our model was able to significantly improve its performance on new tasks without catastrophic forgetting of previously learned tasks. |
format | Online Article Text |
id | pubmed-10670890 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-106708902023-10-31 Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference Matsumoto, Takazumi Ohata, Wataru Tani, Jun Entropy (Basel) Article This study investigated how a physical robot can adapt goal-directed actions in dynamically changing environments, in real-time, using an active inference-based approach with incremental learning from human tutoring examples. Using our active inference-based model, while good generalization can be achieved with appropriate parameters, when faced with sudden, large changes in the environment, a human may have to intervene to correct actions of the robot in order to reach the goal, as a caregiver might guide the hands of a child performing an unfamiliar task. In order for the robot to learn from the human tutor, we propose a new scheme to accomplish incremental learning from these proprioceptive–exteroceptive experiences combined with mental rehearsal of past experiences. Our experimental results demonstrate that using only a few tutoring examples, the robot using our model was able to significantly improve its performance on new tasks without catastrophic forgetting of previously learned tasks. MDPI 2023-10-31 /pmc/articles/PMC10670890/ /pubmed/37998198 http://dx.doi.org/10.3390/e25111506 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Matsumoto, Takazumi Ohata, Wataru Tani, Jun Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference |
title | Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference |
title_full | Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference |
title_fullStr | Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference |
title_full_unstemmed | Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference |
title_short | Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference |
title_sort | incremental learning of goal-directed actions in a dynamic environment by a robot using active inference |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10670890/ https://www.ncbi.nlm.nih.gov/pubmed/37998198 http://dx.doi.org/10.3390/e25111506 |
work_keys_str_mv | AT matsumototakazumi incrementallearningofgoaldirectedactionsinadynamicenvironmentbyarobotusingactiveinference AT ohatawataru incrementallearningofgoaldirectedactionsinadynamicenvironmentbyarobotusingactiveinference AT tanijun incrementallearningofgoaldirectedactionsinadynamicenvironmentbyarobotusingactiveinference |