Cargando…
Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network
Developing an efficient and quality remote sensing (RS) technology using volume and efficient modelling in different aircraft RS images is challenging. Generative models serve as a natural and convenient simulation method. Because aircraft types belong to the fine class under the rough class, the is...
Autores principales: | , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8748831/ https://www.ncbi.nlm.nih.gov/pubmed/35013409 http://dx.doi.org/10.1038/s41598-021-03880-x |
_version_ | 1784631093894316032 |
---|---|
author | Chen, Junyu Li, Haiwei Song, Liyao Zhang, Geng Hu, Bingliang Wang, Shuang Liu, Song Li, Siyuan Chen, Tieqiao Liu, Jia |
author_facet | Chen, Junyu Li, Haiwei Song, Liyao Zhang, Geng Hu, Bingliang Wang, Shuang Liu, Song Li, Siyuan Chen, Tieqiao Liu, Jia |
author_sort | Chen, Junyu |
collection | PubMed |
description | Developing an efficient and quality remote sensing (RS) technology using volume and efficient modelling in different aircraft RS images is challenging. Generative models serve as a natural and convenient simulation method. Because aircraft types belong to the fine class under the rough class, the issue of feature entanglement may occur while modelling multiple aircraft classes. Our solution to this issue was a novel first-generation realistic aircraft type simulation system (ATSS-1) based on the RS images. It realised fine modelling of the seven aircraft types based on a real scene by establishing an adaptive weighted conditional attention generative adversarial network and joint geospatial embedding (GE) network. An adaptive weighted conditional batch normalisation attention block solved the subclass entanglement by reassigning the intra-class-wise characteristic responses. Subsequently, an asymmetric residual self-attention module was developed by establishing a remote region asymmetric relationship for mining the finer potential spatial representation. The mapping relationship between the input RS scene and the potential space of the generated samples was explored through the GE network construction that used the selected prior distribution z, as an intermediate representation. A public RS dataset (OPT-Aircraft_V1.0) and two public datasets (MNIST and Fashion-MNIST) were used for simulation model testing. The results demonstrated the effectiveness of ATSS-1, promoting further development of realistic automatic RS simulation. |
format | Online Article Text |
id | pubmed-8748831 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-87488312022-01-11 Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network Chen, Junyu Li, Haiwei Song, Liyao Zhang, Geng Hu, Bingliang Wang, Shuang Liu, Song Li, Siyuan Chen, Tieqiao Liu, Jia Sci Rep Article Developing an efficient and quality remote sensing (RS) technology using volume and efficient modelling in different aircraft RS images is challenging. Generative models serve as a natural and convenient simulation method. Because aircraft types belong to the fine class under the rough class, the issue of feature entanglement may occur while modelling multiple aircraft classes. Our solution to this issue was a novel first-generation realistic aircraft type simulation system (ATSS-1) based on the RS images. It realised fine modelling of the seven aircraft types based on a real scene by establishing an adaptive weighted conditional attention generative adversarial network and joint geospatial embedding (GE) network. An adaptive weighted conditional batch normalisation attention block solved the subclass entanglement by reassigning the intra-class-wise characteristic responses. Subsequently, an asymmetric residual self-attention module was developed by establishing a remote region asymmetric relationship for mining the finer potential spatial representation. The mapping relationship between the input RS scene and the potential space of the generated samples was explored through the GE network construction that used the selected prior distribution z, as an intermediate representation. A public RS dataset (OPT-Aircraft_V1.0) and two public datasets (MNIST and Fashion-MNIST) were used for simulation model testing. The results demonstrated the effectiveness of ATSS-1, promoting further development of realistic automatic RS simulation. Nature Publishing Group UK 2022-01-10 /pmc/articles/PMC8748831/ /pubmed/35013409 http://dx.doi.org/10.1038/s41598-021-03880-x Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Chen, Junyu Li, Haiwei Song, Liyao Zhang, Geng Hu, Bingliang Wang, Shuang Liu, Song Li, Siyuan Chen, Tieqiao Liu, Jia Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network |
title | Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network |
title_full | Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network |
title_fullStr | Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network |
title_full_unstemmed | Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network |
title_short | Synthetic aircraft RS image modelling based on improved conditional GAN joint embedding network |
title_sort | synthetic aircraft rs image modelling based on improved conditional gan joint embedding network |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8748831/ https://www.ncbi.nlm.nih.gov/pubmed/35013409 http://dx.doi.org/10.1038/s41598-021-03880-x |
work_keys_str_mv | AT chenjunyu syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork AT lihaiwei syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork AT songliyao syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork AT zhanggeng syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork AT hubingliang syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork AT wangshuang syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork AT liusong syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork AT lisiyuan syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork AT chentieqiao syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork AT liujia syntheticaircraftrsimagemodellingbasedonimprovedconditionalganjointembeddingnetwork |