Cargando…

Adaptive visual detection of industrial product defects

Visual inspection of the appearance defects on industrial products has always been a research hotspot pursued by industry and academia. Due to the lack of samples in the industrial defect dataset and the serious class imbalance, deep learning technology cannot be directly applied to industrial defec...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Haigang, Wang, Dong, Chen, Zhibin, Pan, Ronghui
Formato: Online Artículo Texto
Lenguaje:English
Publicado: PeerJ Inc. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10280690/
https://www.ncbi.nlm.nih.gov/pubmed/37346517
http://dx.doi.org/10.7717/peerj-cs.1264
_version_ 1785060853436907520
author Zhang, Haigang
Wang, Dong
Chen, Zhibin
Pan, Ronghui
author_facet Zhang, Haigang
Wang, Dong
Chen, Zhibin
Pan, Ronghui
author_sort Zhang, Haigang
collection PubMed
description Visual inspection of the appearance defects on industrial products has always been a research hotspot pursued by industry and academia. Due to the lack of samples in the industrial defect dataset and the serious class imbalance, deep learning technology cannot be directly applied to industrial defect visual inspection to meet the real application needs. Transfer learning is a good choice to deal with insufficient samples. However, cross-dataset bias is unavoidable during simple knowledge transfer. We noticed that the appearance defects of industrial products are similar, and most defects can be classified as stains or texture jumps, which provides a research basis for building a universal and adaptive industrial defect detection model. In this article, based on the idea of model-agnostic meta-learning (MAML), we propose an adaptive industrial defect detection model through learning from multiple known industrial defect datasets and then transfer it to the novel anomaly detection tasks. In addition, the Siamese network is used to extract differential features to minimize the influence of defect types on model generalization, and can also highlight defect features and improve model detection performance. At the same time, we add a coordinate attention mechanism to the model, which realizes the feature enhancement of the region of interest in terms of two coordinate dimensions. In the simulation experiments, we construct and publish a visual defect dataset of injection molded bottle cups, termed BC defects, which can complement existing industrial defect visual data benchmarks. Simulation results based on BC defects dataset and other public datasets have demonstrated the effectiveness of the proposed general visual detection model for industrial defects. The dataset and code are available at https://github.com/zhg-SZPT/MeDetection.
format Online
Article
Text
id pubmed-10280690
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher PeerJ Inc.
record_format MEDLINE/PubMed
spelling pubmed-102806902023-06-21 Adaptive visual detection of industrial product defects Zhang, Haigang Wang, Dong Chen, Zhibin Pan, Ronghui PeerJ Comput Sci Algorithms and Analysis of Algorithms Visual inspection of the appearance defects on industrial products has always been a research hotspot pursued by industry and academia. Due to the lack of samples in the industrial defect dataset and the serious class imbalance, deep learning technology cannot be directly applied to industrial defect visual inspection to meet the real application needs. Transfer learning is a good choice to deal with insufficient samples. However, cross-dataset bias is unavoidable during simple knowledge transfer. We noticed that the appearance defects of industrial products are similar, and most defects can be classified as stains or texture jumps, which provides a research basis for building a universal and adaptive industrial defect detection model. In this article, based on the idea of model-agnostic meta-learning (MAML), we propose an adaptive industrial defect detection model through learning from multiple known industrial defect datasets and then transfer it to the novel anomaly detection tasks. In addition, the Siamese network is used to extract differential features to minimize the influence of defect types on model generalization, and can also highlight defect features and improve model detection performance. At the same time, we add a coordinate attention mechanism to the model, which realizes the feature enhancement of the region of interest in terms of two coordinate dimensions. In the simulation experiments, we construct and publish a visual defect dataset of injection molded bottle cups, termed BC defects, which can complement existing industrial defect visual data benchmarks. Simulation results based on BC defects dataset and other public datasets have demonstrated the effectiveness of the proposed general visual detection model for industrial defects. The dataset and code are available at https://github.com/zhg-SZPT/MeDetection. PeerJ Inc. 2023-03-15 /pmc/articles/PMC10280690/ /pubmed/37346517 http://dx.doi.org/10.7717/peerj-cs.1264 Text en © 2023 Zhang et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited.
spellingShingle Algorithms and Analysis of Algorithms
Zhang, Haigang
Wang, Dong
Chen, Zhibin
Pan, Ronghui
Adaptive visual detection of industrial product defects
title Adaptive visual detection of industrial product defects
title_full Adaptive visual detection of industrial product defects
title_fullStr Adaptive visual detection of industrial product defects
title_full_unstemmed Adaptive visual detection of industrial product defects
title_short Adaptive visual detection of industrial product defects
title_sort adaptive visual detection of industrial product defects
topic Algorithms and Analysis of Algorithms
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10280690/
https://www.ncbi.nlm.nih.gov/pubmed/37346517
http://dx.doi.org/10.7717/peerj-cs.1264
work_keys_str_mv AT zhanghaigang adaptivevisualdetectionofindustrialproductdefects
AT wangdong adaptivevisualdetectionofindustrialproductdefects
AT chenzhibin adaptivevisualdetectionofindustrialproductdefects
AT panronghui adaptivevisualdetectionofindustrialproductdefects