Cargando…

Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning

Recently, the machine-vision-based blades surface damage detection technique has received great attention for its low cost, easy operation, and lack of a need for prior knowledge. The rapid progress of deep learning has contributed to the promotion of this technology with automatic feature extractio...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Chen, Yang, Tao, Yang, Jing
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9415496/
https://www.ncbi.nlm.nih.gov/pubmed/36015768
http://dx.doi.org/10.3390/s22166009
_version_ 1784776246049112064
author Zhang, Chen
Yang, Tao
Yang, Jing
author_facet Zhang, Chen
Yang, Tao
Yang, Jing
author_sort Zhang, Chen
collection PubMed
description Recently, the machine-vision-based blades surface damage detection technique has received great attention for its low cost, easy operation, and lack of a need for prior knowledge. The rapid progress of deep learning has contributed to the promotion of this technology with automatic feature extraction, a broader scope of application, and stronger expansibility. An image recognition method of wind turbine blade defects using attention-based MobileNetv1-YOLOv4 and transfer learning is proposed in this paper. The backbone convolution neural network of YOLOv4 is replaced by the lightweight MobileNetv1 for feature extraction to reduce complexity and computation. Attention-based feature refinement with three distinctive modules, SENet, ECANet, and CBAM, is introduced to realize adaptive feature optimization. To solve the problem of slow network convergence and low detection accuracy caused by insufficient data, a two-stage transfer learning approach is introduced to fine-tune the pre-trained network. Comparative experiments verify the efficacy of the proposed model, with higher detection accuracy but a significantly faster response speed and less computational complexity, compared with other state-of-the-art networks by using images of the wind turbine blades taken by an unmanned aerial vehicle (UAV). A sensitivity study is also conducted to present the effects of different training dataset sizes on the model performance.
format Online
Article
Text
id pubmed-9415496
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-94154962022-08-27 Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning Zhang, Chen Yang, Tao Yang, Jing Sensors (Basel) Article Recently, the machine-vision-based blades surface damage detection technique has received great attention for its low cost, easy operation, and lack of a need for prior knowledge. The rapid progress of deep learning has contributed to the promotion of this technology with automatic feature extraction, a broader scope of application, and stronger expansibility. An image recognition method of wind turbine blade defects using attention-based MobileNetv1-YOLOv4 and transfer learning is proposed in this paper. The backbone convolution neural network of YOLOv4 is replaced by the lightweight MobileNetv1 for feature extraction to reduce complexity and computation. Attention-based feature refinement with three distinctive modules, SENet, ECANet, and CBAM, is introduced to realize adaptive feature optimization. To solve the problem of slow network convergence and low detection accuracy caused by insufficient data, a two-stage transfer learning approach is introduced to fine-tune the pre-trained network. Comparative experiments verify the efficacy of the proposed model, with higher detection accuracy but a significantly faster response speed and less computational complexity, compared with other state-of-the-art networks by using images of the wind turbine blades taken by an unmanned aerial vehicle (UAV). A sensitivity study is also conducted to present the effects of different training dataset sizes on the model performance. MDPI 2022-08-11 /pmc/articles/PMC9415496/ /pubmed/36015768 http://dx.doi.org/10.3390/s22166009 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhang, Chen
Yang, Tao
Yang, Jing
Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning
title Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning
title_full Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning
title_fullStr Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning
title_full_unstemmed Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning
title_short Image Recognition of Wind Turbine Blade Defects Using Attention-Based MobileNetv1-YOLOv4 and Transfer Learning
title_sort image recognition of wind turbine blade defects using attention-based mobilenetv1-yolov4 and transfer learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9415496/
https://www.ncbi.nlm.nih.gov/pubmed/36015768
http://dx.doi.org/10.3390/s22166009
work_keys_str_mv AT zhangchen imagerecognitionofwindturbinebladedefectsusingattentionbasedmobilenetv1yolov4andtransferlearning
AT yangtao imagerecognitionofwindturbinebladedefectsusingattentionbasedmobilenetv1yolov4andtransferlearning
AT yangjing imagerecognitionofwindturbinebladedefectsusingattentionbasedmobilenetv1yolov4andtransferlearning