Cargando…
Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning
Recently, the machine-vision-based blades surface damage detection technique has received great attention for its low cost, easy operation, and lack of a need for prior knowledge. The rapid progress of deep learning has contributed to the promotion of this technology with automatic feature extractio...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9415496/ https://www.ncbi.nlm.nih.gov/pubmed/36015768 http://dx.doi.org/10.3390/s22166009 |
_version_ | 1784776246049112064 |
---|---|
author | Zhang, Chen Yang, Tao Yang, Jing |
author_facet | Zhang, Chen Yang, Tao Yang, Jing |
author_sort | Zhang, Chen |
collection | PubMed |
description | Recently, the machine-vision-based blades surface damage detection technique has received great attention for its low cost, easy operation, and lack of a need for prior knowledge. The rapid progress of deep learning has contributed to the promotion of this technology with automatic feature extraction, a broader scope of application, and stronger expansibility. An image recognition method of wind turbine blade defects using attention-based MobileNetv1-YOLOv4 and transfer learning is proposed in this paper. The backbone convolution neural network of YOLOv4 is replaced by the lightweight MobileNetv1 for feature extraction to reduce complexity and computation. Attention-based feature refinement with three distinctive modules, SENet, ECANet, and CBAM, is introduced to realize adaptive feature optimization. To solve the problem of slow network convergence and low detection accuracy caused by insufficient data, a two-stage transfer learning approach is introduced to fine-tune the pre-trained network. Comparative experiments verify the efficacy of the proposed model, with higher detection accuracy but a significantly faster response speed and less computational complexity, compared with other state-of-the-art networks by using images of the wind turbine blades taken by an unmanned aerial vehicle (UAV). A sensitivity study is also conducted to present the effects of different training dataset sizes on the model performance. |
format | Online Article Text |
id | pubmed-9415496 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-94154962022-08-27 Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning Zhang, Chen Yang, Tao Yang, Jing Sensors (Basel) Article Recently, the machine-vision-based blades surface damage detection technique has received great attention for its low cost, easy operation, and lack of a need for prior knowledge. The rapid progress of deep learning has contributed to the promotion of this technology with automatic feature extraction, a broader scope of application, and stronger expansibility. An image recognition method of wind turbine blade defects using attention-based MobileNetv1-YOLOv4 and transfer learning is proposed in this paper. The backbone convolution neural network of YOLOv4 is replaced by the lightweight MobileNetv1 for feature extraction to reduce complexity and computation. Attention-based feature refinement with three distinctive modules, SENet, ECANet, and CBAM, is introduced to realize adaptive feature optimization. To solve the problem of slow network convergence and low detection accuracy caused by insufficient data, a two-stage transfer learning approach is introduced to fine-tune the pre-trained network. Comparative experiments verify the efficacy of the proposed model, with higher detection accuracy but a significantly faster response speed and less computational complexity, compared with other state-of-the-art networks by using images of the wind turbine blades taken by an unmanned aerial vehicle (UAV). A sensitivity study is also conducted to present the effects of different training dataset sizes on the model performance. MDPI 2022-08-11 /pmc/articles/PMC9415496/ /pubmed/36015768 http://dx.doi.org/10.3390/s22166009 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Zhang, Chen Yang, Tao Yang, Jing Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning |
title | Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning |
title_full | Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning |
title_fullStr | Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning |
title_full_unstemmed | Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning |
title_short | Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning |
title_sort | image recognition of wind turbine blade defects using attention-based mobilenetv1-yolov4 and transfer learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9415496/ https://www.ncbi.nlm.nih.gov/pubmed/36015768 http://dx.doi.org/10.3390/s22166009 |
work_keys_str_mv | AT zhangchen imagerecognitionofwindturbinebladedefectsusingattentionbasedmobilenetv1yolov4andtransferlearning AT yangtao imagerecognitionofwindturbinebladedefectsusingattentionbasedmobilenetv1yolov4andtransferlearning AT yangjing imagerecognitionofwindturbinebladedefectsusingattentionbasedmobilenetv1yolov4andtransferlearning |