Cargando…

Spatio-Temporal Super-Resolution Reconstruction of Remote-Sensing Images Based on Adaptive Multi-Scale Detail Enhancement

There are many problems in existing reconstruction-based super-resolution algorithms, such as the lack of texture-feature representation and of high-frequency details. Multi-scale detail enhancement can produce more texture information and high-frequency information. Therefore, super-resolution reco...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhu, Hong, Tang, Xinming, Xie, Junfeng, Song, Weidong, Mo, Fan, Gao, Xiaoming
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5855159/
https://www.ncbi.nlm.nih.gov/pubmed/29414893
http://dx.doi.org/10.3390/s18020498
_version_ 1783307042975383552
author Zhu, Hong
Tang, Xinming
Xie, Junfeng
Song, Weidong
Mo, Fan
Gao, Xiaoming
author_facet Zhu, Hong
Tang, Xinming
Xie, Junfeng
Song, Weidong
Mo, Fan
Gao, Xiaoming
author_sort Zhu, Hong
collection PubMed
description There are many problems in existing reconstruction-based super-resolution algorithms, such as the lack of texture-feature representation and of high-frequency details. Multi-scale detail enhancement can produce more texture information and high-frequency information. Therefore, super-resolution reconstruction of remote-sensing images based on adaptive multi-scale detail enhancement (AMDE-SR) is proposed in this paper. First, the information entropy of each remote-sensing image is calculated, and the image with the maximum entropy value is regarded as the reference image. Subsequently, spatio-temporal remote-sensing images are processed using phase normalization, which is to reduce the time phase difference of image data and enhance the complementarity of information. The multi-scale image information is then decomposed using the L(0) gradient minimization model, and the non-redundant information is processed by difference calculation and expanding non-redundant layers and the redundant layer by the iterative back-projection (IBP) technique. The different-scale non-redundant information is adaptive-weighted and fused using cross-entropy. Finally, a nonlinear texture-detail-enhancement function is built to improve the scope of small details, and the peak signal-to-noise ratio (PSNR) is used as an iterative constraint. Ultimately, high-resolution remote-sensing images with abundant texture information are obtained by iterative optimization. Real results show an average gain in entropy of up to 0.42 dB for an up-scaling of 2 and a significant promotion gain in enhancement measure evaluation for an up-scaling of 2. The experimental results show that the performance of the AMED-SR method is better than existing super-resolution reconstruction methods in terms of visual and accuracy improvements.
format Online
Article
Text
id pubmed-5855159
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-58551592018-03-20 Spatio-Temporal Super-Resolution Reconstruction of Remote-Sensing Images Based on Adaptive Multi-Scale Detail Enhancement Zhu, Hong Tang, Xinming Xie, Junfeng Song, Weidong Mo, Fan Gao, Xiaoming Sensors (Basel) Article There are many problems in existing reconstruction-based super-resolution algorithms, such as the lack of texture-feature representation and of high-frequency details. Multi-scale detail enhancement can produce more texture information and high-frequency information. Therefore, super-resolution reconstruction of remote-sensing images based on adaptive multi-scale detail enhancement (AMDE-SR) is proposed in this paper. First, the information entropy of each remote-sensing image is calculated, and the image with the maximum entropy value is regarded as the reference image. Subsequently, spatio-temporal remote-sensing images are processed using phase normalization, which is to reduce the time phase difference of image data and enhance the complementarity of information. The multi-scale image information is then decomposed using the L(0) gradient minimization model, and the non-redundant information is processed by difference calculation and expanding non-redundant layers and the redundant layer by the iterative back-projection (IBP) technique. The different-scale non-redundant information is adaptive-weighted and fused using cross-entropy. Finally, a nonlinear texture-detail-enhancement function is built to improve the scope of small details, and the peak signal-to-noise ratio (PSNR) is used as an iterative constraint. Ultimately, high-resolution remote-sensing images with abundant texture information are obtained by iterative optimization. Real results show an average gain in entropy of up to 0.42 dB for an up-scaling of 2 and a significant promotion gain in enhancement measure evaluation for an up-scaling of 2. The experimental results show that the performance of the AMED-SR method is better than existing super-resolution reconstruction methods in terms of visual and accuracy improvements. MDPI 2018-02-07 /pmc/articles/PMC5855159/ /pubmed/29414893 http://dx.doi.org/10.3390/s18020498 Text en © 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhu, Hong
Tang, Xinming
Xie, Junfeng
Song, Weidong
Mo, Fan
Gao, Xiaoming
Spatio-Temporal Super-Resolution Reconstruction of Remote-Sensing Images Based on Adaptive Multi-Scale Detail Enhancement
title Spatio-Temporal Super-Resolution Reconstruction of Remote-Sensing Images Based on Adaptive Multi-Scale Detail Enhancement
title_full Spatio-Temporal Super-Resolution Reconstruction of Remote-Sensing Images Based on Adaptive Multi-Scale Detail Enhancement
title_fullStr Spatio-Temporal Super-Resolution Reconstruction of Remote-Sensing Images Based on Adaptive Multi-Scale Detail Enhancement
title_full_unstemmed Spatio-Temporal Super-Resolution Reconstruction of Remote-Sensing Images Based on Adaptive Multi-Scale Detail Enhancement
title_short Spatio-Temporal Super-Resolution Reconstruction of Remote-Sensing Images Based on Adaptive Multi-Scale Detail Enhancement
title_sort spatio-temporal super-resolution reconstruction of remote-sensing images based on adaptive multi-scale detail enhancement
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5855159/
https://www.ncbi.nlm.nih.gov/pubmed/29414893
http://dx.doi.org/10.3390/s18020498
work_keys_str_mv AT zhuhong spatiotemporalsuperresolutionreconstructionofremotesensingimagesbasedonadaptivemultiscaledetailenhancement
AT tangxinming spatiotemporalsuperresolutionreconstructionofremotesensingimagesbasedonadaptivemultiscaledetailenhancement
AT xiejunfeng spatiotemporalsuperresolutionreconstructionofremotesensingimagesbasedonadaptivemultiscaledetailenhancement
AT songweidong spatiotemporalsuperresolutionreconstructionofremotesensingimagesbasedonadaptivemultiscaledetailenhancement
AT mofan spatiotemporalsuperresolutionreconstructionofremotesensingimagesbasedonadaptivemultiscaledetailenhancement
AT gaoxiaoming spatiotemporalsuperresolutionreconstructionofremotesensingimagesbasedonadaptivemultiscaledetailenhancement