Cargando…

Dynamic graph convolutional network for assembly behavior recognition based on attention mechanism and multi-scale feature fusion

Intelligent recognition of assembly behaviors of workshop production personnel is crucial to improve production assembly efficiency and ensure production safety. This paper proposes a graph convolutional network model for assembly behavior recognition based on attention mechanism and multi-scale fea...

Descripción completa

Detalles Bibliográficos
Autores principales: Chen, Chengjun, Zhao, Xicong, Wang, Jinlei, Li, Dongnian, Guan, Yuanlin, Hong, Jun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9072355/
https://www.ncbi.nlm.nih.gov/pubmed/35513554
http://dx.doi.org/10.1038/s41598-022-11206-8
_version_ 1784701042427953152
author Chen, Chengjun
Zhao, Xicong
Wang, Jinlei
Li, Dongnian
Guan, Yuanlin
Hong, Jun
author_facet Chen, Chengjun
Zhao, Xicong
Wang, Jinlei
Li, Dongnian
Guan, Yuanlin
Hong, Jun
author_sort Chen, Chengjun
collection PubMed
description Intelligent recognition of assembly behaviors of workshop production personnel is crucial to improve production assembly efficiency and ensure production safety. This paper proposes a graph convolutional network model for assembly behavior recognition based on attention mechanism and multi-scale feature fusion. The proposed model learns the potential relationship between assembly actions and assembly tools for recognizing assembly behaviors. Meanwhile, the introduction of an attention mechanism helps the network to focus on the key information in assembly behavior images. Besides, the multi-scale feature fusion module is introduced to enable the network to better extract image features at different scales. This paper constructs a data set containing 15 types of workshop production behaviors, and the proposed assembly behavior recognition model is tested on this data set. The experimental results show that the proposed model achieves good recognition results, with an average assembly recognition accuracy of 93.1%.
format Online
Article
Text
id pubmed-9072355
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-90723552022-05-07 Dynamic graph convolutional network for assembly behavior recognition based on attention mechanism and multi-scale feature fusion Chen, Chengjun Zhao, Xicong Wang, Jinlei Li, Dongnian Guan, Yuanlin Hong, Jun Sci Rep Article Intelligent recognition of assembly behaviors of workshop production personnel is crucial to improve production assembly efficiency and ensure production safety. This paper proposes a graph convolutional network model for assembly behavior recognition based on attention mechanism and multi-scale feature fusion. The proposed model learns the potential relationship between assembly actions and assembly tools for recognizing assembly behaviors. Meanwhile, the introduction of an attention mechanism helps the network to focus on the key information in assembly behavior images. Besides, the multi-scale feature fusion module is introduced to enable the network to better extract image features at different scales. This paper constructs a data set containing 15 types of workshop production behaviors, and the proposed assembly behavior recognition model is tested on this data set. The experimental results show that the proposed model achieves good recognition results, with an average assembly recognition accuracy of 93.1%. Nature Publishing Group UK 2022-05-05 /pmc/articles/PMC9072355/ /pubmed/35513554 http://dx.doi.org/10.1038/s41598-022-11206-8 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Chen, Chengjun
Zhao, Xicong
Wang, Jinlei
Li, Dongnian
Guan, Yuanlin
Hong, Jun
Dynamic graph convolutional network for assembly behavior recognition based on attention mechanism and multi-scale feature fusion
title Dynamic graph convolutional network for assembly behavior recognition based on attention mechanism and multi-scale feature fusion
title_full Dynamic graph convolutional network for assembly behavior recognition based on attention mechanism and multi-scale feature fusion
title_fullStr Dynamic graph convolutional network for assembly behavior recognition based on attention mechanism and multi-scale feature fusion
title_full_unstemmed Dynamic graph convolutional network for assembly behavior recognition based on attention mechanism and multi-scale feature fusion
title_short Dynamic graph convolutional network for assembly behavior recognition based on attention mechanism and multi-scale feature fusion
title_sort dynamic graph convolutional network for assembly behavior recognition based on attention mechanism and multi-scale feature fusion
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9072355/
https://www.ncbi.nlm.nih.gov/pubmed/35513554
http://dx.doi.org/10.1038/s41598-022-11206-8
work_keys_str_mv AT chenchengjun dynamicgraphconvolutionalnetworkforassemblybehaviorrecognitionbasedonattentionmechanismandmultiscalefeaturefusion
AT zhaoxicong dynamicgraphconvolutionalnetworkforassemblybehaviorrecognitionbasedonattentionmechanismandmultiscalefeaturefusion
AT wangjinlei dynamicgraphconvolutionalnetworkforassemblybehaviorrecognitionbasedonattentionmechanismandmultiscalefeaturefusion
AT lidongnian dynamicgraphconvolutionalnetworkforassemblybehaviorrecognitionbasedonattentionmechanismandmultiscalefeaturefusion
AT guanyuanlin dynamicgraphconvolutionalnetworkforassemblybehaviorrecognitionbasedonattentionmechanismandmultiscalefeaturefusion
AT hongjun dynamicgraphconvolutionalnetworkforassemblybehaviorrecognitionbasedonattentionmechanismandmultiscalefeaturefusion