Cargando…

Infrared Image Super Resolution by Combining Compressive Sensing and Deep Learning

Super resolution methods alleviate the high cost and high difficulty in applying high resolution infrared image sensors. In this paper we present a novel single image super resolution method for infrared images by combining compressive sensing theory and deep learning. Low resolution images can be r...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Xudong, Li, Chunlai, Meng, Qingpeng, Liu, Shijie, Zhang, Yue, Wang, Jianyu
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6111996/
https://www.ncbi.nlm.nih.gov/pubmed/30087286
http://dx.doi.org/10.3390/s18082587
_version_ 1783350770551226368
author Zhang, Xudong
Li, Chunlai
Meng, Qingpeng
Liu, Shijie
Zhang, Yue
Wang, Jianyu
author_facet Zhang, Xudong
Li, Chunlai
Meng, Qingpeng
Liu, Shijie
Zhang, Yue
Wang, Jianyu
author_sort Zhang, Xudong
collection PubMed
description Super resolution methods alleviate the high cost and high difficulty in applying high resolution infrared image sensors. In this paper we present a novel single image super resolution method for infrared images by combining compressive sensing theory and deep learning. Low resolution images can be regarded as the compressed sampling results of the high resolution ones in compressive sensing. With sparsity in this theory, higher resolution images can be reconstructed. However, because of diverse level of sparsity for different images, the output contains noise and loss of high frequency information. Deep convolutional neural network provides a solution to relieve the noise and supplement some missing high frequency information. By concatenating two methods, we manage to produce better results in super resolution tasks for infrared images than SRCNN and ScSR. PSNR and SSIM values are used to quantify the performance. Applying our method to open datasets and actual infrared imaging experiments, we also find better visual results are preserved.
format Online
Article
Text
id pubmed-6111996
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-61119962018-08-30 Infrared Image Super Resolution by Combining Compressive Sensing and Deep Learning Zhang, Xudong Li, Chunlai Meng, Qingpeng Liu, Shijie Zhang, Yue Wang, Jianyu Sensors (Basel) Article Super resolution methods alleviate the high cost and high difficulty in applying high resolution infrared image sensors. In this paper we present a novel single image super resolution method for infrared images by combining compressive sensing theory and deep learning. Low resolution images can be regarded as the compressed sampling results of the high resolution ones in compressive sensing. With sparsity in this theory, higher resolution images can be reconstructed. However, because of diverse level of sparsity for different images, the output contains noise and loss of high frequency information. Deep convolutional neural network provides a solution to relieve the noise and supplement some missing high frequency information. By concatenating two methods, we manage to produce better results in super resolution tasks for infrared images than SRCNN and ScSR. PSNR and SSIM values are used to quantify the performance. Applying our method to open datasets and actual infrared imaging experiments, we also find better visual results are preserved. MDPI 2018-08-07 /pmc/articles/PMC6111996/ /pubmed/30087286 http://dx.doi.org/10.3390/s18082587 Text en © 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhang, Xudong
Li, Chunlai
Meng, Qingpeng
Liu, Shijie
Zhang, Yue
Wang, Jianyu
Infrared Image Super Resolution by Combining Compressive Sensing and Deep Learning
title Infrared Image Super Resolution by Combining Compressive Sensing and Deep Learning
title_full Infrared Image Super Resolution by Combining Compressive Sensing and Deep Learning
title_fullStr Infrared Image Super Resolution by Combining Compressive Sensing and Deep Learning
title_full_unstemmed Infrared Image Super Resolution by Combining Compressive Sensing and Deep Learning
title_short Infrared Image Super Resolution by Combining Compressive Sensing and Deep Learning
title_sort infrared image super resolution by combining compressive sensing and deep learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6111996/
https://www.ncbi.nlm.nih.gov/pubmed/30087286
http://dx.doi.org/10.3390/s18082587
work_keys_str_mv AT zhangxudong infraredimagesuperresolutionbycombiningcompressivesensinganddeeplearning
AT lichunlai infraredimagesuperresolutionbycombiningcompressivesensinganddeeplearning
AT mengqingpeng infraredimagesuperresolutionbycombiningcompressivesensinganddeeplearning
AT liushijie infraredimagesuperresolutionbycombiningcompressivesensinganddeeplearning
AT zhangyue infraredimagesuperresolutionbycombiningcompressivesensinganddeeplearning
AT wangjianyu infraredimagesuperresolutionbycombiningcompressivesensinganddeeplearning