Cargando…
FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition
It is important to reduce the danger of collecting flame image data sets by compositing flame images by computer. In this paper, a Global-Local mask Generative Adversarial Network (FGL-GAN) is proposed to address the current status of low quality composite flame images. First, FGL-GAN adopts a hiera...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9460294/ https://www.ncbi.nlm.nih.gov/pubmed/36080788 http://dx.doi.org/10.3390/s22176332 |
_version_ | 1784786712032968704 |
---|---|
author | Qin, Kui Hou, Xinguo Yan, Zhengjun Zhou, Feng Bu, Leping |
author_facet | Qin, Kui Hou, Xinguo Yan, Zhengjun Zhou, Feng Bu, Leping |
author_sort | Qin, Kui |
collection | PubMed |
description | It is important to reduce the danger of collecting flame image data sets by compositing flame images by computer. In this paper, a Global-Local mask Generative Adversarial Network (FGL-GAN) is proposed to address the current status of low quality composite flame images. First, FGL-GAN adopts a hierarchical Global-Local generator structure, to locally render high-quality flame halo and reflection, while also maintaining a consistent global style. Second, FGL-GAN incorporates the fire mask as part of the input of the generation module, which improves the rendering quality of flame halo and reflection. A new data augmentation technique for flame image compositing is used in the network training process to reconstruct the background and reduce the influence of distractors on the network. Finally, FGL-GAN introduces the idea of contrastive learning to speed up network fitting and reduce blurriness in composite images. Comparative experiments show that the images composited by FGL-GAN have achieved better performance in qualitative and quantitative evaluation than mainstream GAN. Ablation study shows the effectiveness of the hierarchical Global-Local generator structure, fire mask, data augmentation, and MONCE loss of FGL-GAN. Therefore, a large number of new flame images can be composited by FGL-GAN, which can provide extensive test data for fire detection equipment, based on deep learning algorithms. |
format | Online Article Text |
id | pubmed-9460294 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-94602942022-09-10 FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition Qin, Kui Hou, Xinguo Yan, Zhengjun Zhou, Feng Bu, Leping Sensors (Basel) Article It is important to reduce the danger of collecting flame image data sets by compositing flame images by computer. In this paper, a Global-Local mask Generative Adversarial Network (FGL-GAN) is proposed to address the current status of low quality composite flame images. First, FGL-GAN adopts a hierarchical Global-Local generator structure, to locally render high-quality flame halo and reflection, while also maintaining a consistent global style. Second, FGL-GAN incorporates the fire mask as part of the input of the generation module, which improves the rendering quality of flame halo and reflection. A new data augmentation technique for flame image compositing is used in the network training process to reconstruct the background and reduce the influence of distractors on the network. Finally, FGL-GAN introduces the idea of contrastive learning to speed up network fitting and reduce blurriness in composite images. Comparative experiments show that the images composited by FGL-GAN have achieved better performance in qualitative and quantitative evaluation than mainstream GAN. Ablation study shows the effectiveness of the hierarchical Global-Local generator structure, fire mask, data augmentation, and MONCE loss of FGL-GAN. Therefore, a large number of new flame images can be composited by FGL-GAN, which can provide extensive test data for fire detection equipment, based on deep learning algorithms. MDPI 2022-08-23 /pmc/articles/PMC9460294/ /pubmed/36080788 http://dx.doi.org/10.3390/s22176332 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Qin, Kui Hou, Xinguo Yan, Zhengjun Zhou, Feng Bu, Leping FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition |
title | FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition |
title_full | FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition |
title_fullStr | FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition |
title_full_unstemmed | FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition |
title_short | FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition |
title_sort | fgl-gan: global-local mask generative adversarial network for flame image composition |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9460294/ https://www.ncbi.nlm.nih.gov/pubmed/36080788 http://dx.doi.org/10.3390/s22176332 |
work_keys_str_mv | AT qinkui fglgangloballocalmaskgenerativeadversarialnetworkforflameimagecomposition AT houxinguo fglgangloballocalmaskgenerativeadversarialnetworkforflameimagecomposition AT yanzhengjun fglgangloballocalmaskgenerativeadversarialnetworkforflameimagecomposition AT zhoufeng fglgangloballocalmaskgenerativeadversarialnetworkforflameimagecomposition AT buleping fglgangloballocalmaskgenerativeadversarialnetworkforflameimagecomposition |