Cargando…
Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning
With the rise of Industry 4.0 and artificial intelligence, the demand for industrial automation and precise control has increased. Machine learning can reduce the cost of machine parameter tuning and improve high-precision positioning motion. In this study, a visual image recognition system was used...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10058194/ https://www.ncbi.nlm.nih.gov/pubmed/36991742 http://dx.doi.org/10.3390/s23063027 |
_version_ | 1785016563443695616 |
---|---|
author | Huang, Yi-Cheng Chan, Yung-Chun |
author_facet | Huang, Yi-Cheng Chan, Yung-Chun |
author_sort | Huang, Yi-Cheng |
collection | PubMed |
description | With the rise of Industry 4.0 and artificial intelligence, the demand for industrial automation and precise control has increased. Machine learning can reduce the cost of machine parameter tuning and improve high-precision positioning motion. In this study, a visual image recognition system was used to observe the displacement of an XXY planar platform. Ball-screw clearance, backlash, nonlinear frictional force, and other factors affect the accuracy and reproducibility of positioning. Therefore, the actual positioning error was determined by inputting images captured by a charge-coupled device camera into a reinforcement Q-learning algorithm. Time-differential learning and accumulated rewards were used to perform Q-value iteration to enable optimal platform positioning. A deep Q-network model was constructed and trained through reinforcement learning for effectively estimating the XXY platform’s positioning error and predicting the command compensation according to the error history. The constructed model was validated through simulations. The adopted methodology can be extended to other control applications based on the interaction between feedback measurement and artificial intelligence. |
format | Online Article Text |
id | pubmed-10058194 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-100581942023-03-30 Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning Huang, Yi-Cheng Chan, Yung-Chun Sensors (Basel) Article With the rise of Industry 4.0 and artificial intelligence, the demand for industrial automation and precise control has increased. Machine learning can reduce the cost of machine parameter tuning and improve high-precision positioning motion. In this study, a visual image recognition system was used to observe the displacement of an XXY planar platform. Ball-screw clearance, backlash, nonlinear frictional force, and other factors affect the accuracy and reproducibility of positioning. Therefore, the actual positioning error was determined by inputting images captured by a charge-coupled device camera into a reinforcement Q-learning algorithm. Time-differential learning and accumulated rewards were used to perform Q-value iteration to enable optimal platform positioning. A deep Q-network model was constructed and trained through reinforcement learning for effectively estimating the XXY platform’s positioning error and predicting the command compensation according to the error history. The constructed model was validated through simulations. The adopted methodology can be extended to other control applications based on the interaction between feedback measurement and artificial intelligence. MDPI 2023-03-10 /pmc/articles/PMC10058194/ /pubmed/36991742 http://dx.doi.org/10.3390/s23063027 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Huang, Yi-Cheng Chan, Yung-Chun Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning |
title | Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning |
title_full | Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning |
title_fullStr | Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning |
title_full_unstemmed | Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning |
title_short | Manipulating XXY Planar Platform Positioning Accuracy by Computer Vision Based on Reinforcement Learning |
title_sort | manipulating xxy planar platform positioning accuracy by computer vision based on reinforcement learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10058194/ https://www.ncbi.nlm.nih.gov/pubmed/36991742 http://dx.doi.org/10.3390/s23063027 |
work_keys_str_mv | AT huangyicheng manipulatingxxyplanarplatformpositioningaccuracybycomputervisionbasedonreinforcementlearning AT chanyungchun manipulatingxxyplanarplatformpositioningaccuracybycomputervisionbasedonreinforcementlearning |