Cargando…

Mixed Receptive Fields Augmented YOLO with Multi-Path Spatial Pyramid Pooling for Steel Surface Defect Detection

Aiming at the problems of low detection efficiency and poor detection accuracy caused by texture feature interference and dramatic changes in the scale of defect on steel surfaces, an improved YOLOv5s model is proposed. In this study, we propose a novel re-parameterized large kernel C3 module, which...

Descripción completa

Detalles Bibliográficos
Autores principales: Xia, Kewen, Lv, Zhongliang, Zhou, Chuande, Gu, Guojun, Zhao, Zhiqiang, Liu, Kang, Li, Zelun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10255213/
https://www.ncbi.nlm.nih.gov/pubmed/37299841
http://dx.doi.org/10.3390/s23115114
_version_ 1785056816349052928
author Xia, Kewen
Lv, Zhongliang
Zhou, Chuande
Gu, Guojun
Zhao, Zhiqiang
Liu, Kang
Li, Zelun
author_facet Xia, Kewen
Lv, Zhongliang
Zhou, Chuande
Gu, Guojun
Zhao, Zhiqiang
Liu, Kang
Li, Zelun
author_sort Xia, Kewen
collection PubMed
description Aiming at the problems of low detection efficiency and poor detection accuracy caused by texture feature interference and dramatic changes in the scale of defect on steel surfaces, an improved YOLOv5s model is proposed. In this study, we propose a novel re-parameterized large kernel C3 module, which enables the model to obtain a larger effective receptive field and improve the ability of feature extraction under complex texture interference. Moreover, we construct a feature fusion structure with a multi-path spatial pyramid pooling module to adapt to the scale variation of steel surface defects. Finally, we propose a training strategy that applies different kernel sizes for feature maps of different scales so that the receptive field of the model can adapt to the scale changes of the feature maps to the greatest extent. The experiment on the NEU-DET dataset shows that our model improved the detection accuracy of crazing and rolled in-scale, which contain a large number of weak texture features and are densely distributed by 14.4% and 11.1%, respectively. Additionally, the detection accuracy of inclusion and scratched defects with prominent scale changes and significant shape features was improved by 10.5% and 6.6%, respectively. Meanwhile, the mean average precision value reaches 76.8%, compared with the YOLOv5s and YOLOv8s, which increased by 8.6% and 3.7%, respectively.
format Online
Article
Text
id pubmed-10255213
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-102552132023-06-10 Mixed Receptive Fields Augmented YOLO with Multi-Path Spatial Pyramid Pooling for Steel Surface Defect Detection Xia, Kewen Lv, Zhongliang Zhou, Chuande Gu, Guojun Zhao, Zhiqiang Liu, Kang Li, Zelun Sensors (Basel) Article Aiming at the problems of low detection efficiency and poor detection accuracy caused by texture feature interference and dramatic changes in the scale of defect on steel surfaces, an improved YOLOv5s model is proposed. In this study, we propose a novel re-parameterized large kernel C3 module, which enables the model to obtain a larger effective receptive field and improve the ability of feature extraction under complex texture interference. Moreover, we construct a feature fusion structure with a multi-path spatial pyramid pooling module to adapt to the scale variation of steel surface defects. Finally, we propose a training strategy that applies different kernel sizes for feature maps of different scales so that the receptive field of the model can adapt to the scale changes of the feature maps to the greatest extent. The experiment on the NEU-DET dataset shows that our model improved the detection accuracy of crazing and rolled in-scale, which contain a large number of weak texture features and are densely distributed by 14.4% and 11.1%, respectively. Additionally, the detection accuracy of inclusion and scratched defects with prominent scale changes and significant shape features was improved by 10.5% and 6.6%, respectively. Meanwhile, the mean average precision value reaches 76.8%, compared with the YOLOv5s and YOLOv8s, which increased by 8.6% and 3.7%, respectively. MDPI 2023-05-27 /pmc/articles/PMC10255213/ /pubmed/37299841 http://dx.doi.org/10.3390/s23115114 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Xia, Kewen
Lv, Zhongliang
Zhou, Chuande
Gu, Guojun
Zhao, Zhiqiang
Liu, Kang
Li, Zelun
Mixed Receptive Fields Augmented YOLO with Multi-Path Spatial Pyramid Pooling for Steel Surface Defect Detection
title Mixed Receptive Fields Augmented YOLO with Multi-Path Spatial Pyramid Pooling for Steel Surface Defect Detection
title_full Mixed Receptive Fields Augmented YOLO with Multi-Path Spatial Pyramid Pooling for Steel Surface Defect Detection
title_fullStr Mixed Receptive Fields Augmented YOLO with Multi-Path Spatial Pyramid Pooling for Steel Surface Defect Detection
title_full_unstemmed Mixed Receptive Fields Augmented YOLO with Multi-Path Spatial Pyramid Pooling for Steel Surface Defect Detection
title_short Mixed Receptive Fields Augmented YOLO with Multi-Path Spatial Pyramid Pooling for Steel Surface Defect Detection
title_sort mixed receptive fields augmented yolo with multi-path spatial pyramid pooling for steel surface defect detection
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10255213/
https://www.ncbi.nlm.nih.gov/pubmed/37299841
http://dx.doi.org/10.3390/s23115114
work_keys_str_mv AT xiakewen mixedreceptivefieldsaugmentedyolowithmultipathspatialpyramidpoolingforsteelsurfacedefectdetection
AT lvzhongliang mixedreceptivefieldsaugmentedyolowithmultipathspatialpyramidpoolingforsteelsurfacedefectdetection
AT zhouchuande mixedreceptivefieldsaugmentedyolowithmultipathspatialpyramidpoolingforsteelsurfacedefectdetection
AT guguojun mixedreceptivefieldsaugmentedyolowithmultipathspatialpyramidpoolingforsteelsurfacedefectdetection
AT zhaozhiqiang mixedreceptivefieldsaugmentedyolowithmultipathspatialpyramidpoolingforsteelsurfacedefectdetection
AT liukang mixedreceptivefieldsaugmentedyolowithmultipathspatialpyramidpoolingforsteelsurfacedefectdetection
AT lizelun mixedreceptivefieldsaugmentedyolowithmultipathspatialpyramidpoolingforsteelsurfacedefectdetection