Cargando…
High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD
Research on coal foreign object detection based on deep learning is of great significance to safe, efficient, and green production of coal mines. However, the foreign object image dataset is scarce due to collection conditions, which brings an enormous challenge to coal foreign object detection. To...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9823712/ https://www.ncbi.nlm.nih.gov/pubmed/36616972 http://dx.doi.org/10.3390/s23010374 |
_version_ | 1784866227981647872 |
---|---|
author | Cao, Xiangang Wei, Hengyang Wang, Peng Zhang, Chiyu Huang, Shikai Li, Hu |
author_facet | Cao, Xiangang Wei, Hengyang Wang, Peng Zhang, Chiyu Huang, Shikai Li, Hu |
author_sort | Cao, Xiangang |
collection | PubMed |
description | Research on coal foreign object detection based on deep learning is of great significance to safe, efficient, and green production of coal mines. However, the foreign object image dataset is scarce due to collection conditions, which brings an enormous challenge to coal foreign object detection. To achieve augmentation of foreign object datasets, a high-quality coal foreign object image generation method based on improved StyleGAN is proposed. Firstly, the dual self-attention module is introduced into the generator to strengthen the long-distance dependence of features between spatial and channel, refine the details of the generated images, accurately distinguish the front background information, and improve the quality of the generated images. Secondly, the depthwise separable convolution is introduced into the discriminator to solve the problem of low efficiency caused by the large number of parameters of multi-stage convolutional networks, to realize the lightweight model, and to accelerate the training speed. Experimental results show that the improved model has significant advantages over several classical GANS and original StyleGAN in terms of quality and diversity of the generated images, with an average improvement of 2.52 in IS and a decrease of 5.80 in FID for each category. As for the model complexity, the parameters and training time of the improved model are reduced to 44.6% and 58.8% of the original model without affecting the generated images quality. Finally, the results of applying different data augmentation methods to the foreign object detection task show that our image generation method is more effective than the traditional methods, and that, under the optimal conditions, it improves AP(box) by 5.8% and AP(mask) by 4.5%. |
format | Online Article Text |
id | pubmed-9823712 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-98237122023-01-08 High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD Cao, Xiangang Wei, Hengyang Wang, Peng Zhang, Chiyu Huang, Shikai Li, Hu Sensors (Basel) Article Research on coal foreign object detection based on deep learning is of great significance to safe, efficient, and green production of coal mines. However, the foreign object image dataset is scarce due to collection conditions, which brings an enormous challenge to coal foreign object detection. To achieve augmentation of foreign object datasets, a high-quality coal foreign object image generation method based on improved StyleGAN is proposed. Firstly, the dual self-attention module is introduced into the generator to strengthen the long-distance dependence of features between spatial and channel, refine the details of the generated images, accurately distinguish the front background information, and improve the quality of the generated images. Secondly, the depthwise separable convolution is introduced into the discriminator to solve the problem of low efficiency caused by the large number of parameters of multi-stage convolutional networks, to realize the lightweight model, and to accelerate the training speed. Experimental results show that the improved model has significant advantages over several classical GANS and original StyleGAN in terms of quality and diversity of the generated images, with an average improvement of 2.52 in IS and a decrease of 5.80 in FID for each category. As for the model complexity, the parameters and training time of the improved model are reduced to 44.6% and 58.8% of the original model without affecting the generated images quality. Finally, the results of applying different data augmentation methods to the foreign object detection task show that our image generation method is more effective than the traditional methods, and that, under the optimal conditions, it improves AP(box) by 5.8% and AP(mask) by 4.5%. MDPI 2022-12-29 /pmc/articles/PMC9823712/ /pubmed/36616972 http://dx.doi.org/10.3390/s23010374 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Cao, Xiangang Wei, Hengyang Wang, Peng Zhang, Chiyu Huang, Shikai Li, Hu High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD |
title | High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD |
title_full | High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD |
title_fullStr | High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD |
title_full_unstemmed | High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD |
title_short | High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD |
title_sort | high quality coal foreign object image generation method based on stylegan-dsad |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9823712/ https://www.ncbi.nlm.nih.gov/pubmed/36616972 http://dx.doi.org/10.3390/s23010374 |
work_keys_str_mv | AT caoxiangang highqualitycoalforeignobjectimagegenerationmethodbasedonstylegandsad AT weihengyang highqualitycoalforeignobjectimagegenerationmethodbasedonstylegandsad AT wangpeng highqualitycoalforeignobjectimagegenerationmethodbasedonstylegandsad AT zhangchiyu highqualitycoalforeignobjectimagegenerationmethodbasedonstylegandsad AT huangshikai highqualitycoalforeignobjectimagegenerationmethodbasedonstylegandsad AT lihu highqualitycoalforeignobjectimagegenerationmethodbasedonstylegandsad |