Cargando…
Learning adaptive reaching and pushing skills using contact information
In this paper, we propose a deep reinforcement learning-based framework that enables adaptive and continuous control of a robot to push unseen objects from random positions to the target position. Our approach takes into account contact information in the design of the reward function, resulting in...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10536165/ https://www.ncbi.nlm.nih.gov/pubmed/37781411 http://dx.doi.org/10.3389/fnbot.2023.1271607 |
_version_ | 1785112801257193472 |
---|---|
author | Wang, Shuaijun Sun, Lining Zha, Fusheng Guo, Wei Wang, Pengfei |
author_facet | Wang, Shuaijun Sun, Lining Zha, Fusheng Guo, Wei Wang, Pengfei |
author_sort | Wang, Shuaijun |
collection | PubMed |
description | In this paper, we propose a deep reinforcement learning-based framework that enables adaptive and continuous control of a robot to push unseen objects from random positions to the target position. Our approach takes into account contact information in the design of the reward function, resulting in improved success rates, generalization for unseen objects, and task efficiency compared to policies that do not consider contact information. Through reinforcement learning using only one object in simulation, we obtain a learned policy for manipulating a single object, which demonstrates good generalization when applied to the task of pushing unseen objects. Finally, we validate the effectiveness of our approach in real-world scenarios. |
format | Online Article Text |
id | pubmed-10536165 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-105361652023-09-29 Learning adaptive reaching and pushing skills using contact information Wang, Shuaijun Sun, Lining Zha, Fusheng Guo, Wei Wang, Pengfei Front Neurorobot Neuroscience In this paper, we propose a deep reinforcement learning-based framework that enables adaptive and continuous control of a robot to push unseen objects from random positions to the target position. Our approach takes into account contact information in the design of the reward function, resulting in improved success rates, generalization for unseen objects, and task efficiency compared to policies that do not consider contact information. Through reinforcement learning using only one object in simulation, we obtain a learned policy for manipulating a single object, which demonstrates good generalization when applied to the task of pushing unseen objects. Finally, we validate the effectiveness of our approach in real-world scenarios. Frontiers Media S.A. 2023-09-14 /pmc/articles/PMC10536165/ /pubmed/37781411 http://dx.doi.org/10.3389/fnbot.2023.1271607 Text en Copyright © 2023 Wang, Sun, Zha, Guo and Wang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Wang, Shuaijun Sun, Lining Zha, Fusheng Guo, Wei Wang, Pengfei Learning adaptive reaching and pushing skills using contact information |
title | Learning adaptive reaching and pushing skills using contact information |
title_full | Learning adaptive reaching and pushing skills using contact information |
title_fullStr | Learning adaptive reaching and pushing skills using contact information |
title_full_unstemmed | Learning adaptive reaching and pushing skills using contact information |
title_short | Learning adaptive reaching and pushing skills using contact information |
title_sort | learning adaptive reaching and pushing skills using contact information |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10536165/ https://www.ncbi.nlm.nih.gov/pubmed/37781411 http://dx.doi.org/10.3389/fnbot.2023.1271607 |
work_keys_str_mv | AT wangshuaijun learningadaptivereachingandpushingskillsusingcontactinformation AT sunlining learningadaptivereachingandpushingskillsusingcontactinformation AT zhafusheng learningadaptivereachingandpushingskillsusingcontactinformation AT guowei learningadaptivereachingandpushingskillsusingcontactinformation AT wangpengfei learningadaptivereachingandpushingskillsusingcontactinformation |