Cargando…

Deep Q-Learning in Robotics: Improvement of Accuracy and Repeatability

Recent industrial robotics covers a broad part of the manufacturing spectrum and other human everyday life applications; the performance of these devices has become increasingly important. Positioning accuracy and repeatability, as well as operating speed, are essential in any industrial robotics ap...

Descripción completa

Detalles Bibliográficos
Autores principales: Sumanas, Marius, Petronis, Algirdas, Bucinskas, Vytautas, Dzedzickis, Andrius, Virzonis, Darius, Morkvenaite-Vilkonciene, Inga
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9147322/
https://www.ncbi.nlm.nih.gov/pubmed/35632319
http://dx.doi.org/10.3390/s22103911
_version_ 1784716778965827584
author Sumanas, Marius
Petronis, Algirdas
Bucinskas, Vytautas
Dzedzickis, Andrius
Virzonis, Darius
Morkvenaite-Vilkonciene, Inga
author_facet Sumanas, Marius
Petronis, Algirdas
Bucinskas, Vytautas
Dzedzickis, Andrius
Virzonis, Darius
Morkvenaite-Vilkonciene, Inga
author_sort Sumanas, Marius
collection PubMed
description Recent industrial robotics covers a broad part of the manufacturing spectrum and other human everyday life applications; the performance of these devices has become increasingly important. Positioning accuracy and repeatability, as well as operating speed, are essential in any industrial robotics application. Robot positioning errors are complex due to the extensive combination of their sources and cannot be compensated for using conventional methods. Some robot positioning errors can be compensated for only using machine learning (ML) procedures. Reinforced machine learning increases the robot’s positioning accuracy and expands its implementation capabilities. The provided methodology presents an easy and focused approach for industrial in situ robot position adjustment in real-time during production setup or readjustment cases. The scientific value of this approach is a methodology using an ML procedure without huge external datasets for the procedure and extensive computing facilities. This paper presents a deep q-learning algorithm applied to improve the positioning accuracy of an articulated KUKA youBot robot during operation. A significant improvement of the positioning accuracy was achieved approximately after 260 iterations in the online mode and initial simulation of the ML procedure.
format Online
Article
Text
id pubmed-9147322
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-91473222022-05-29 Deep Q-Learning in Robotics: Improvement of Accuracy and Repeatability Sumanas, Marius Petronis, Algirdas Bucinskas, Vytautas Dzedzickis, Andrius Virzonis, Darius Morkvenaite-Vilkonciene, Inga Sensors (Basel) Article Recent industrial robotics covers a broad part of the manufacturing spectrum and other human everyday life applications; the performance of these devices has become increasingly important. Positioning accuracy and repeatability, as well as operating speed, are essential in any industrial robotics application. Robot positioning errors are complex due to the extensive combination of their sources and cannot be compensated for using conventional methods. Some robot positioning errors can be compensated for only using machine learning (ML) procedures. Reinforced machine learning increases the robot’s positioning accuracy and expands its implementation capabilities. The provided methodology presents an easy and focused approach for industrial in situ robot position adjustment in real-time during production setup or readjustment cases. The scientific value of this approach is a methodology using an ML procedure without huge external datasets for the procedure and extensive computing facilities. This paper presents a deep q-learning algorithm applied to improve the positioning accuracy of an articulated KUKA youBot robot during operation. A significant improvement of the positioning accuracy was achieved approximately after 260 iterations in the online mode and initial simulation of the ML procedure. MDPI 2022-05-21 /pmc/articles/PMC9147322/ /pubmed/35632319 http://dx.doi.org/10.3390/s22103911 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Sumanas, Marius
Petronis, Algirdas
Bucinskas, Vytautas
Dzedzickis, Andrius
Virzonis, Darius
Morkvenaite-Vilkonciene, Inga
Deep Q-Learning in Robotics: Improvement of Accuracy and Repeatability
title Deep Q-Learning in Robotics: Improvement of Accuracy and Repeatability
title_full Deep Q-Learning in Robotics: Improvement of Accuracy and Repeatability
title_fullStr Deep Q-Learning in Robotics: Improvement of Accuracy and Repeatability
title_full_unstemmed Deep Q-Learning in Robotics: Improvement of Accuracy and Repeatability
title_short Deep Q-Learning in Robotics: Improvement of Accuracy and Repeatability
title_sort deep q-learning in robotics: improvement of accuracy and repeatability
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9147322/
https://www.ncbi.nlm.nih.gov/pubmed/35632319
http://dx.doi.org/10.3390/s22103911
work_keys_str_mv AT sumanasmarius deepqlearninginroboticsimprovementofaccuracyandrepeatability
AT petronisalgirdas deepqlearninginroboticsimprovementofaccuracyandrepeatability
AT bucinskasvytautas deepqlearninginroboticsimprovementofaccuracyandrepeatability
AT dzedzickisandrius deepqlearninginroboticsimprovementofaccuracyandrepeatability
AT virzonisdarius deepqlearninginroboticsimprovementofaccuracyandrepeatability
AT morkvenaitevilkoncieneinga deepqlearninginroboticsimprovementofaccuracyandrepeatability