Cargando…

Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network

Developing an efficient and quality remote sensing (RS) technology using volume and efficient modelling in different aircraft RS images is challenging. Generative models serve as a natural and convenient simulation method. Because aircraft types belong to the fine class under the rough class, the is...

Descripción completa

Detalles Bibliográficos
Autores principales: Chen, Junyu, Li, Haiwei, Song, Liyao, Zhang, Geng, Hu, Bingliang, Wang, Shuang, Liu, Song, Li, Siyuan, Chen, Tieqiao, Liu, Jia
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8748831/
https://www.ncbi.nlm.nih.gov/pubmed/35013409
http://dx.doi.org/10.1038/s41598-021-03880-x
_version_ 1784631093894316032
author Chen, Junyu
Li, Haiwei
Song, Liyao
Zhang, Geng
Hu, Bingliang
Wang, Shuang
Liu, Song
Li, Siyuan
Chen, Tieqiao
Liu, Jia
author_facet Chen, Junyu
Li, Haiwei
Song, Liyao
Zhang, Geng
Hu, Bingliang
Wang, Shuang
Liu, Song
Li, Siyuan
Chen, Tieqiao
Liu, Jia
author_sort Chen, Junyu
collection PubMed
description Developing an efficient and quality remote sensing (RS) technology using volume and efficient modelling in different aircraft RS images is challenging. Generative models serve as a natural and convenient simulation method. Because aircraft types belong to the fine class under the rough class, the issue of feature entanglement may occur while modelling multiple aircraft classes. Our solution to this issue was a novel first-generation realistic aircraft type simulation system (ATSS-1) based on the RS images. It realised fine modelling of the seven aircraft types based on a real scene by establishing an adaptive weighted conditional attention generative adversarial network and joint geospatial embedding (GE) network. An adaptive weighted conditional batch normalisation attention block solved the subclass entanglement by reassigning the intra-class-wise characteristic responses. Subsequently, an asymmetric residual self-attention module was developed by establishing a remote region asymmetric relationship for mining the finer potential spatial representation. The mapping relationship between the input RS scene and the potential space of the generated samples was explored through the GE network construction that used the selected prior distribution z, as an intermediate representation. A public RS dataset (OPT-Aircraft_V1.0) and two public datasets (MNIST and Fashion-MNIST) were used for simulation model testing. The results demonstrated the effectiveness of ATSS-1, promoting further development of realistic automatic RS simulation.
format Online
Article
Text
id pubmed-8748831
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-87488312022-01-11 Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network Chen, Junyu Li, Haiwei Song, Liyao Zhang, Geng Hu, Bingliang Wang, Shuang Liu, Song Li, Siyuan Chen, Tieqiao Liu, Jia Sci Rep Article Developing an efficient and quality remote sensing (RS) technology using volume and efficient modelling in different aircraft RS images is challenging. Generative models serve as a natural and convenient simulation method. Because aircraft types belong to the fine class under the rough class, the issue of feature entanglement may occur while modelling multiple aircraft classes. Our solution to this issue was a novel first-generation realistic aircraft type simulation system (ATSS-1) based on the RS images. It realised fine modelling of the seven aircraft types based on a real scene by establishing an adaptive weighted conditional attention generative adversarial network and joint geospatial embedding (GE) network. An adaptive weighted conditional batch normalisation attention block solved the subclass entanglement by reassigning the intra-class-wise characteristic responses. Subsequently, an asymmetric residual self-attention module was developed by establishing a remote region asymmetric relationship for mining the finer potential spatial representation. The mapping relationship between the input RS scene and the potential space of the generated samples was explored through the GE network construction that used the selected prior distribution z, as an intermediate representation. A public RS dataset (OPT-Aircraft_V1.0) and two public datasets (MNIST and Fashion-MNIST) were used for simulation model testing. The results demonstrated the effectiveness of ATSS-1, promoting further development of realistic automatic RS simulation. Nature Publishing Group UK 2022-01-10 /pmc/articles/PMC8748831/ /pubmed/35013409 http://dx.doi.org/10.1038/s41598-021-03880-x Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Chen, Junyu
Li, Haiwei
Song, Liyao
Zhang, Geng
Hu, Bingliang
Wang, Shuang
Liu, Song
Li, Siyuan
Chen, Tieqiao
Liu, Jia
Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network
title Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network
title_full Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network
title_fullStr Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network
title_full_unstemmed Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network
title_short Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network
title_sort synthetic aircraft rs image modelling based on improved conditional gan joint embedding network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8748831/
https://www.ncbi.nlm.nih.gov/pubmed/35013409
http://dx.doi.org/10.1038/s41598-021-03880-x
work_keys_str_mv AT chenjunyu syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork
AT lihaiwei syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork
AT songliyao syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork
AT zhanggeng syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork
AT hubingliang syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork
AT wangshuang syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork
AT liusong syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork
AT lisiyuan syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork
AT chentieqiao syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork
AT liujia syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork