Cargando…

High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD

Research on coal foreign object detection based on deep learning is of great significance to safe, efficient, and green production of coal mines. However, the foreign object image dataset is scarce due to collection conditions, which brings an enormous challenge to coal foreign object detection. To...

Descripción completa

Detalles Bibliográficos
Autores principales: Cao, Xiangang, Wei, Hengyang, Wang, Peng, Zhang, Chiyu, Huang, Shikai, Li, Hu
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9823712/
https://www.ncbi.nlm.nih.gov/pubmed/36616972
http://dx.doi.org/10.3390/s23010374
_version_ 1784866227981647872
author Cao, Xiangang
Wei, Hengyang
Wang, Peng
Zhang, Chiyu
Huang, Shikai
Li, Hu
author_facet Cao, Xiangang
Wei, Hengyang
Wang, Peng
Zhang, Chiyu
Huang, Shikai
Li, Hu
author_sort Cao, Xiangang
collection PubMed
description Research on coal foreign object detection based on deep learning is of great significance to safe, efficient, and green production of coal mines. However, the foreign object image dataset is scarce due to collection conditions, which brings an enormous challenge to coal foreign object detection. To achieve augmentation of foreign object datasets, a high-quality coal foreign object image generation method based on improved StyleGAN is proposed. Firstly, the dual self-attention module is introduced into the generator to strengthen the long-distance dependence of features between spatial and channel, refine the details of the generated images, accurately distinguish the front background information, and improve the quality of the generated images. Secondly, the depthwise separable convolution is introduced into the discriminator to solve the problem of low efficiency caused by the large number of parameters of multi-stage convolutional networks, to realize the lightweight model, and to accelerate the training speed. Experimental results show that the improved model has significant advantages over several classical GANS and original StyleGAN in terms of quality and diversity of the generated images, with an average improvement of 2.52 in IS and a decrease of 5.80 in FID for each category. As for the model complexity, the parameters and training time of the improved model are reduced to 44.6% and 58.8% of the original model without affecting the generated images quality. Finally, the results of applying different data augmentation methods to the foreign object detection task show that our image generation method is more effective than the traditional methods, and that, under the optimal conditions, it improves AP(box) by 5.8% and AP(mask) by 4.5%.
format Online
Article
Text
id pubmed-9823712
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-98237122023-01-08 High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD Cao, Xiangang Wei, Hengyang Wang, Peng Zhang, Chiyu Huang, Shikai Li, Hu Sensors (Basel) Article Research on coal foreign object detection based on deep learning is of great significance to safe, efficient, and green production of coal mines. However, the foreign object image dataset is scarce due to collection conditions, which brings an enormous challenge to coal foreign object detection. To achieve augmentation of foreign object datasets, a high-quality coal foreign object image generation method based on improved StyleGAN is proposed. Firstly, the dual self-attention module is introduced into the generator to strengthen the long-distance dependence of features between spatial and channel, refine the details of the generated images, accurately distinguish the front background information, and improve the quality of the generated images. Secondly, the depthwise separable convolution is introduced into the discriminator to solve the problem of low efficiency caused by the large number of parameters of multi-stage convolutional networks, to realize the lightweight model, and to accelerate the training speed. Experimental results show that the improved model has significant advantages over several classical GANS and original StyleGAN in terms of quality and diversity of the generated images, with an average improvement of 2.52 in IS and a decrease of 5.80 in FID for each category. As for the model complexity, the parameters and training time of the improved model are reduced to 44.6% and 58.8% of the original model without affecting the generated images quality. Finally, the results of applying different data augmentation methods to the foreign object detection task show that our image generation method is more effective than the traditional methods, and that, under the optimal conditions, it improves AP(box) by 5.8% and AP(mask) by 4.5%. MDPI 2022-12-29 /pmc/articles/PMC9823712/ /pubmed/36616972 http://dx.doi.org/10.3390/s23010374 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Cao, Xiangang
Wei, Hengyang
Wang, Peng
Zhang, Chiyu
Huang, Shikai
Li, Hu
High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD
title High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD
title_full High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD
title_fullStr High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD
title_full_unstemmed High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD
title_short High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD
title_sort high quality coal foreign object image generation method based on stylegan-dsad
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9823712/
https://www.ncbi.nlm.nih.gov/pubmed/36616972
http://dx.doi.org/10.3390/s23010374
work_keys_str_mv AT caoxiangang highqualitycoalforeignobjectimagegenerationmethodbasedonstylegandsad
AT weihengyang highqualitycoalforeignobjectimagegenerationmethodbasedonstylegandsad
AT wangpeng highqualitycoalforeignobjectimagegenerationmethodbasedonstylegandsad
AT zhangchiyu highqualitycoalforeignobjectimagegenerationmethodbasedonstylegandsad
AT huangshikai highqualitycoalforeignobjectimagegenerationmethodbasedonstylegandsad
AT lihu highqualitycoalforeignobjectimagegenerationmethodbasedonstylegandsad