Cargando…

Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference

This study investigated how a physical robot can adapt goal-directed actions in dynamically changing environments, in real-time, using an active inference-based approach with incremental learning from human tutoring examples. Using our active inference-based model, while good generalization can be a...

Descripción completa

Detalles Bibliográficos
Autores principales: Matsumoto, Takazumi, Ohata, Wataru, Tani, Jun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10670890/
https://www.ncbi.nlm.nih.gov/pubmed/37998198
http://dx.doi.org/10.3390/e25111506
_version_ 1785140025793445888
author Matsumoto, Takazumi
Ohata, Wataru
Tani, Jun
author_facet Matsumoto, Takazumi
Ohata, Wataru
Tani, Jun
author_sort Matsumoto, Takazumi
collection PubMed
description This study investigated how a physical robot can adapt goal-directed actions in dynamically changing environments, in real-time, using an active inference-based approach with incremental learning from human tutoring examples. Using our active inference-based model, while good generalization can be achieved with appropriate parameters, when faced with sudden, large changes in the environment, a human may have to intervene to correct actions of the robot in order to reach the goal, as a caregiver might guide the hands of a child performing an unfamiliar task. In order for the robot to learn from the human tutor, we propose a new scheme to accomplish incremental learning from these proprioceptive–exteroceptive experiences combined with mental rehearsal of past experiences. Our experimental results demonstrate that using only a few tutoring examples, the robot using our model was able to significantly improve its performance on new tasks without catastrophic forgetting of previously learned tasks.
format Online
Article
Text
id pubmed-10670890
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-106708902023-10-31 Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference Matsumoto, Takazumi Ohata, Wataru Tani, Jun Entropy (Basel) Article This study investigated how a physical robot can adapt goal-directed actions in dynamically changing environments, in real-time, using an active inference-based approach with incremental learning from human tutoring examples. Using our active inference-based model, while good generalization can be achieved with appropriate parameters, when faced with sudden, large changes in the environment, a human may have to intervene to correct actions of the robot in order to reach the goal, as a caregiver might guide the hands of a child performing an unfamiliar task. In order for the robot to learn from the human tutor, we propose a new scheme to accomplish incremental learning from these proprioceptive–exteroceptive experiences combined with mental rehearsal of past experiences. Our experimental results demonstrate that using only a few tutoring examples, the robot using our model was able to significantly improve its performance on new tasks without catastrophic forgetting of previously learned tasks. MDPI 2023-10-31 /pmc/articles/PMC10670890/ /pubmed/37998198 http://dx.doi.org/10.3390/e25111506 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Matsumoto, Takazumi
Ohata, Wataru
Tani, Jun
Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference
title Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference
title_full Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference
title_fullStr Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference
title_full_unstemmed Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference
title_short Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference
title_sort incremental learning of goal-directed actions in a dynamic environment by a robot using active inference
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10670890/
https://www.ncbi.nlm.nih.gov/pubmed/37998198
http://dx.doi.org/10.3390/e25111506
work_keys_str_mv AT matsumototakazumi incrementallearningofgoaldirectedactionsinadynamicenvironmentbyarobotusingactiveinference
AT ohatawataru incrementallearningofgoaldirectedactionsinadynamicenvironmentbyarobotusingactiveinference
AT tanijun incrementallearningofgoaldirectedactionsinadynamicenvironmentbyarobotusingactiveinference