Cargando…

Learning adaptive reaching and pushing skills using contact information

In this paper, we propose a deep reinforcement learning-based framework that enables adaptive and continuous control of a robot to push unseen objects from random positions to the target position. Our approach takes into account contact information in the design of the reward function, resulting in...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Shuaijun, Sun, Lining, Zha, Fusheng, Guo, Wei, Wang, Pengfei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10536165/
https://www.ncbi.nlm.nih.gov/pubmed/37781411
http://dx.doi.org/10.3389/fnbot.2023.1271607
_version_ 1785112801257193472
author Wang, Shuaijun
Sun, Lining
Zha, Fusheng
Guo, Wei
Wang, Pengfei
author_facet Wang, Shuaijun
Sun, Lining
Zha, Fusheng
Guo, Wei
Wang, Pengfei
author_sort Wang, Shuaijun
collection PubMed
description In this paper, we propose a deep reinforcement learning-based framework that enables adaptive and continuous control of a robot to push unseen objects from random positions to the target position. Our approach takes into account contact information in the design of the reward function, resulting in improved success rates, generalization for unseen objects, and task efficiency compared to policies that do not consider contact information. Through reinforcement learning using only one object in simulation, we obtain a learned policy for manipulating a single object, which demonstrates good generalization when applied to the task of pushing unseen objects. Finally, we validate the effectiveness of our approach in real-world scenarios.
format Online
Article
Text
id pubmed-10536165
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-105361652023-09-29 Learning adaptive reaching and pushing skills using contact information Wang, Shuaijun Sun, Lining Zha, Fusheng Guo, Wei Wang, Pengfei Front Neurorobot Neuroscience In this paper, we propose a deep reinforcement learning-based framework that enables adaptive and continuous control of a robot to push unseen objects from random positions to the target position. Our approach takes into account contact information in the design of the reward function, resulting in improved success rates, generalization for unseen objects, and task efficiency compared to policies that do not consider contact information. Through reinforcement learning using only one object in simulation, we obtain a learned policy for manipulating a single object, which demonstrates good generalization when applied to the task of pushing unseen objects. Finally, we validate the effectiveness of our approach in real-world scenarios. Frontiers Media S.A. 2023-09-14 /pmc/articles/PMC10536165/ /pubmed/37781411 http://dx.doi.org/10.3389/fnbot.2023.1271607 Text en Copyright © 2023 Wang, Sun, Zha, Guo and Wang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Wang, Shuaijun
Sun, Lining
Zha, Fusheng
Guo, Wei
Wang, Pengfei
Learning adaptive reaching and pushing skills using contact information
title Learning adaptive reaching and pushing skills using contact information
title_full Learning adaptive reaching and pushing skills using contact information
title_fullStr Learning adaptive reaching and pushing skills using contact information
title_full_unstemmed Learning adaptive reaching and pushing skills using contact information
title_short Learning adaptive reaching and pushing skills using contact information
title_sort learning adaptive reaching and pushing skills using contact information
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10536165/
https://www.ncbi.nlm.nih.gov/pubmed/37781411
http://dx.doi.org/10.3389/fnbot.2023.1271607
work_keys_str_mv AT wangshuaijun learningadaptivereachingandpushingskillsusingcontactinformation
AT sunlining learningadaptivereachingandpushingskillsusingcontactinformation
AT zhafusheng learningadaptivereachingandpushingskillsusingcontactinformation
AT guowei learningadaptivereachingandpushingskillsusingcontactinformation
AT wangpengfei learningadaptivereachingandpushingskillsusingcontactinformation