Cargando…

Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning

With the rise of Industry 4.0 and artificial intelligence, the demand for industrial automation and precise control has increased. Machine learning can reduce the cost of machine parameter tuning and improve high-precision positioning motion. In this study, a visual image recognition system was used...

Descripción completa

Detalles Bibliográficos
Autores principales: Huang, Yi-Cheng, Chan, Yung-Chun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10058194/
https://www.ncbi.nlm.nih.gov/pubmed/36991742
http://dx.doi.org/10.3390/s23063027
_version_ 1785016563443695616
author Huang, Yi-Cheng
Chan, Yung-Chun
author_facet Huang, Yi-Cheng
Chan, Yung-Chun
author_sort Huang, Yi-Cheng
collection PubMed
description With the rise of Industry 4.0 and artificial intelligence, the demand for industrial automation and precise control has increased. Machine learning can reduce the cost of machine parameter tuning and improve high-precision positioning motion. In this study, a visual image recognition system was used to observe the displacement of an XXY planar platform. Ball-screw clearance, backlash, nonlinear frictional force, and other factors affect the accuracy and reproducibility of positioning. Therefore, the actual positioning error was determined by inputting images captured by a charge-coupled device camera into a reinforcement Q-learning algorithm. Time-differential learning and accumulated rewards were used to perform Q-value iteration to enable optimal platform positioning. A deep Q-network model was constructed and trained through reinforcement learning for effectively estimating the XXY platform’s positioning error and predicting the command compensation according to the error history. The constructed model was validated through simulations. The adopted methodology can be extended to other control applications based on the interaction between feedback measurement and artificial intelligence.
format Online
Article
Text
id pubmed-10058194
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-100581942023-03-30 Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning Huang, Yi-Cheng Chan, Yung-Chun Sensors (Basel) Article With the rise of Industry 4.0 and artificial intelligence, the demand for industrial automation and precise control has increased. Machine learning can reduce the cost of machine parameter tuning and improve high-precision positioning motion. In this study, a visual image recognition system was used to observe the displacement of an XXY planar platform. Ball-screw clearance, backlash, nonlinear frictional force, and other factors affect the accuracy and reproducibility of positioning. Therefore, the actual positioning error was determined by inputting images captured by a charge-coupled device camera into a reinforcement Q-learning algorithm. Time-differential learning and accumulated rewards were used to perform Q-value iteration to enable optimal platform positioning. A deep Q-network model was constructed and trained through reinforcement learning for effectively estimating the XXY platform’s positioning error and predicting the command compensation according to the error history. The constructed model was validated through simulations. The adopted methodology can be extended to other control applications based on the interaction between feedback measurement and artificial intelligence. MDPI 2023-03-10 /pmc/articles/PMC10058194/ /pubmed/36991742 http://dx.doi.org/10.3390/s23063027 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Huang, Yi-Cheng
Chan, Yung-Chun
Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning
title Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning
title_full Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning
title_fullStr Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning
title_full_unstemmed Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning
title_short Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning
title_sort manipulating xxy planar platform positioning accuracy by computer vision based on reinforcement learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10058194/
https://www.ncbi.nlm.nih.gov/pubmed/36991742
http://dx.doi.org/10.3390/s23063027
work_keys_str_mv AT huangyicheng manipulatingxxyplanarplatformpositioningaccuracybycomputervisionbasedonreinforcementlearning
AT chanyungchun manipulatingxxyplanarplatformpositioningaccuracybycomputervisionbasedonreinforcementlearning