Cargando…

A human-centered safe robot reinforcement learning framework with interactive behaviors

Deployment of Reinforcement Learning (RL) algorithms for robotics applications in the real world requires ensuring the safety of the robot and its environment. Safe Robot RL (SRRL) is a crucial step toward achieving human-robot coexistence. In this paper, we envision a human-centered SRRL framework...

Descripción completa

Detalles Bibliográficos
Autores principales: Gu, Shangding, Kshirsagar, Alap, Du, Yali, Chen, Guang, Peters, Jan, Knoll, Alois
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10665848/
https://www.ncbi.nlm.nih.gov/pubmed/38023448
http://dx.doi.org/10.3389/fnbot.2023.1280341
_version_ 1785138916922228736
author Gu, Shangding
Kshirsagar, Alap
Du, Yali
Chen, Guang
Peters, Jan
Knoll, Alois
author_facet Gu, Shangding
Kshirsagar, Alap
Du, Yali
Chen, Guang
Peters, Jan
Knoll, Alois
author_sort Gu, Shangding
collection PubMed
description Deployment of Reinforcement Learning (RL) algorithms for robotics applications in the real world requires ensuring the safety of the robot and its environment. Safe Robot RL (SRRL) is a crucial step toward achieving human-robot coexistence. In this paper, we envision a human-centered SRRL framework consisting of three stages: safe exploration, safety value alignment, and safe collaboration. We examine the research gaps in these areas and propose to leverage interactive behaviors for SRRL. Interactive behaviors enable bi-directional information transfer between humans and robots, such as conversational robot ChatGPT. We argue that interactive behaviors need further attention from the SRRL community. We discuss four open challenges related to the robustness, efficiency, transparency, and adaptability of SRRL with interactive behaviors.
format Online
Article
Text
id pubmed-10665848
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-106658482023-01-01 A human-centered safe robot reinforcement learning framework with interactive behaviors Gu, Shangding Kshirsagar, Alap Du, Yali Chen, Guang Peters, Jan Knoll, Alois Front Neurorobot Neuroscience Deployment of Reinforcement Learning (RL) algorithms for robotics applications in the real world requires ensuring the safety of the robot and its environment. Safe Robot RL (SRRL) is a crucial step toward achieving human-robot coexistence. In this paper, we envision a human-centered SRRL framework consisting of three stages: safe exploration, safety value alignment, and safe collaboration. We examine the research gaps in these areas and propose to leverage interactive behaviors for SRRL. Interactive behaviors enable bi-directional information transfer between humans and robots, such as conversational robot ChatGPT. We argue that interactive behaviors need further attention from the SRRL community. We discuss four open challenges related to the robustness, efficiency, transparency, and adaptability of SRRL with interactive behaviors. Frontiers Media S.A. 2023-11-09 /pmc/articles/PMC10665848/ /pubmed/38023448 http://dx.doi.org/10.3389/fnbot.2023.1280341 Text en Copyright © 2023 Gu, Kshirsagar, Du, Chen, Peters and Knoll. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Gu, Shangding
Kshirsagar, Alap
Du, Yali
Chen, Guang
Peters, Jan
Knoll, Alois
A human-centered safe robot reinforcement learning framework with interactive behaviors
title A human-centered safe robot reinforcement learning framework with interactive behaviors
title_full A human-centered safe robot reinforcement learning framework with interactive behaviors
title_fullStr A human-centered safe robot reinforcement learning framework with interactive behaviors
title_full_unstemmed A human-centered safe robot reinforcement learning framework with interactive behaviors
title_short A human-centered safe robot reinforcement learning framework with interactive behaviors
title_sort human-centered safe robot reinforcement learning framework with interactive behaviors
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10665848/
https://www.ncbi.nlm.nih.gov/pubmed/38023448
http://dx.doi.org/10.3389/fnbot.2023.1280341
work_keys_str_mv AT gushangding ahumancenteredsaferobotreinforcementlearningframeworkwithinteractivebehaviors
AT kshirsagaralap ahumancenteredsaferobotreinforcementlearningframeworkwithinteractivebehaviors
AT duyali ahumancenteredsaferobotreinforcementlearningframeworkwithinteractivebehaviors
AT chenguang ahumancenteredsaferobotreinforcementlearningframeworkwithinteractivebehaviors
AT petersjan ahumancenteredsaferobotreinforcementlearningframeworkwithinteractivebehaviors
AT knollalois ahumancenteredsaferobotreinforcementlearningframeworkwithinteractivebehaviors
AT gushangding humancenteredsaferobotreinforcementlearningframeworkwithinteractivebehaviors
AT kshirsagaralap humancenteredsaferobotreinforcementlearningframeworkwithinteractivebehaviors
AT duyali humancenteredsaferobotreinforcementlearningframeworkwithinteractivebehaviors
AT chenguang humancenteredsaferobotreinforcementlearningframeworkwithinteractivebehaviors
AT petersjan humancenteredsaferobotreinforcementlearningframeworkwithinteractivebehaviors
AT knollalois humancenteredsaferobotreinforcementlearningframeworkwithinteractivebehaviors