Cargando…

FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition

It is important to reduce the danger of collecting flame image data sets by compositing flame images by computer. In this paper, a Global-Local mask Generative Adversarial Network (FGL-GAN) is proposed to address the current status of low quality composite flame images. First, FGL-GAN adopts a hiera...

Descripción completa

Detalles Bibliográficos
Autores principales: Qin, Kui, Hou, Xinguo, Yan, Zhengjun, Zhou, Feng, Bu, Leping
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9460294/
https://www.ncbi.nlm.nih.gov/pubmed/36080788
http://dx.doi.org/10.3390/s22176332
_version_ 1784786712032968704
author Qin, Kui
Hou, Xinguo
Yan, Zhengjun
Zhou, Feng
Bu, Leping
author_facet Qin, Kui
Hou, Xinguo
Yan, Zhengjun
Zhou, Feng
Bu, Leping
author_sort Qin, Kui
collection PubMed
description It is important to reduce the danger of collecting flame image data sets by compositing flame images by computer. In this paper, a Global-Local mask Generative Adversarial Network (FGL-GAN) is proposed to address the current status of low quality composite flame images. First, FGL-GAN adopts a hierarchical Global-Local generator structure, to locally render high-quality flame halo and reflection, while also maintaining a consistent global style. Second, FGL-GAN incorporates the fire mask as part of the input of the generation module, which improves the rendering quality of flame halo and reflection. A new data augmentation technique for flame image compositing is used in the network training process to reconstruct the background and reduce the influence of distractors on the network. Finally, FGL-GAN introduces the idea of contrastive learning to speed up network fitting and reduce blurriness in composite images. Comparative experiments show that the images composited by FGL-GAN have achieved better performance in qualitative and quantitative evaluation than mainstream GAN. Ablation study shows the effectiveness of the hierarchical Global-Local generator structure, fire mask, data augmentation, and MONCE loss of FGL-GAN. Therefore, a large number of new flame images can be composited by FGL-GAN, which can provide extensive test data for fire detection equipment, based on deep learning algorithms.
format Online
Article
Text
id pubmed-9460294
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-94602942022-09-10 FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition Qin, Kui Hou, Xinguo Yan, Zhengjun Zhou, Feng Bu, Leping Sensors (Basel) Article It is important to reduce the danger of collecting flame image data sets by compositing flame images by computer. In this paper, a Global-Local mask Generative Adversarial Network (FGL-GAN) is proposed to address the current status of low quality composite flame images. First, FGL-GAN adopts a hierarchical Global-Local generator structure, to locally render high-quality flame halo and reflection, while also maintaining a consistent global style. Second, FGL-GAN incorporates the fire mask as part of the input of the generation module, which improves the rendering quality of flame halo and reflection. A new data augmentation technique for flame image compositing is used in the network training process to reconstruct the background and reduce the influence of distractors on the network. Finally, FGL-GAN introduces the idea of contrastive learning to speed up network fitting and reduce blurriness in composite images. Comparative experiments show that the images composited by FGL-GAN have achieved better performance in qualitative and quantitative evaluation than mainstream GAN. Ablation study shows the effectiveness of the hierarchical Global-Local generator structure, fire mask, data augmentation, and MONCE loss of FGL-GAN. Therefore, a large number of new flame images can be composited by FGL-GAN, which can provide extensive test data for fire detection equipment, based on deep learning algorithms. MDPI 2022-08-23 /pmc/articles/PMC9460294/ /pubmed/36080788 http://dx.doi.org/10.3390/s22176332 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Qin, Kui
Hou, Xinguo
Yan, Zhengjun
Zhou, Feng
Bu, Leping
FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition
title FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition
title_full FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition
title_fullStr FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition
title_full_unstemmed FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition
title_short FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition
title_sort fgl-gan: global-local mask generative adversarial network for flame image composition
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9460294/
https://www.ncbi.nlm.nih.gov/pubmed/36080788
http://dx.doi.org/10.3390/s22176332
work_keys_str_mv AT qinkui fglgangloballocalmaskgenerativeadversarialnetworkforflameimagecomposition
AT houxinguo fglgangloballocalmaskgenerativeadversarialnetworkforflameimagecomposition
AT yanzhengjun fglgangloballocalmaskgenerativeadversarialnetworkforflameimagecomposition
AT zhoufeng fglgangloballocalmaskgenerativeadversarialnetworkforflameimagecomposition
AT buleping fglgangloballocalmaskgenerativeadversarialnetworkforflameimagecomposition