Cargando…

A Novel Domain Transfer-Based Approach for Unsupervised Thermal Image Super-Resolution

This paper presents a transfer domain strategy to tackle the limitations of low-resolution thermal sensors and generate higher-resolution images of reasonable quality. The proposed technique employs a CycleGAN architecture and uses a ResNet as an encoder in the generator along with an attention modu...

Descripción completa

Detalles Bibliográficos
Autores principales: Rivadeneira, Rafael E., Sappa, Angel D., Vintimilla, Boris X., Hammoud, Riad
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8953585/
https://www.ncbi.nlm.nih.gov/pubmed/35336426
http://dx.doi.org/10.3390/s22062254
_version_ 1784675887457763328
author Rivadeneira, Rafael E.
Sappa, Angel D.
Vintimilla, Boris X.
Hammoud, Riad
author_facet Rivadeneira, Rafael E.
Sappa, Angel D.
Vintimilla, Boris X.
Hammoud, Riad
author_sort Rivadeneira, Rafael E.
collection PubMed
description This paper presents a transfer domain strategy to tackle the limitations of low-resolution thermal sensors and generate higher-resolution images of reasonable quality. The proposed technique employs a CycleGAN architecture and uses a ResNet as an encoder in the generator along with an attention module and a novel loss function. The network is trained on a multi-resolution thermal image dataset acquired with three different thermal sensors. Results report better performance benchmarking results on the 2nd CVPR-PBVS-2021 thermal image super-resolution challenge than state-of-the-art methods. The code of this work is available online.
format Online
Article
Text
id pubmed-8953585
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-89535852022-03-26 A Novel Domain Transfer-Based Approach for Unsupervised Thermal Image Super-Resolution Rivadeneira, Rafael E. Sappa, Angel D. Vintimilla, Boris X. Hammoud, Riad Sensors (Basel) Article This paper presents a transfer domain strategy to tackle the limitations of low-resolution thermal sensors and generate higher-resolution images of reasonable quality. The proposed technique employs a CycleGAN architecture and uses a ResNet as an encoder in the generator along with an attention module and a novel loss function. The network is trained on a multi-resolution thermal image dataset acquired with three different thermal sensors. Results report better performance benchmarking results on the 2nd CVPR-PBVS-2021 thermal image super-resolution challenge than state-of-the-art methods. The code of this work is available online. MDPI 2022-03-14 /pmc/articles/PMC8953585/ /pubmed/35336426 http://dx.doi.org/10.3390/s22062254 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Rivadeneira, Rafael E.
Sappa, Angel D.
Vintimilla, Boris X.
Hammoud, Riad
A Novel Domain Transfer-Based Approach for Unsupervised Thermal Image Super-Resolution
title A Novel Domain Transfer-Based Approach for Unsupervised Thermal Image Super-Resolution
title_full A Novel Domain Transfer-Based Approach for Unsupervised Thermal Image Super-Resolution
title_fullStr A Novel Domain Transfer-Based Approach for Unsupervised Thermal Image Super-Resolution
title_full_unstemmed A Novel Domain Transfer-Based Approach for Unsupervised Thermal Image Super-Resolution
title_short A Novel Domain Transfer-Based Approach for Unsupervised Thermal Image Super-Resolution
title_sort novel domain transfer-based approach for unsupervised thermal image super-resolution
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8953585/
https://www.ncbi.nlm.nih.gov/pubmed/35336426
http://dx.doi.org/10.3390/s22062254
work_keys_str_mv AT rivadeneirarafaele anoveldomaintransferbasedapproachforunsupervisedthermalimagesuperresolution
AT sappaangeld anoveldomaintransferbasedapproachforunsupervisedthermalimagesuperresolution
AT vintimillaborisx anoveldomaintransferbasedapproachforunsupervisedthermalimagesuperresolution
AT hammoudriad anoveldomaintransferbasedapproachforunsupervisedthermalimagesuperresolution
AT rivadeneirarafaele noveldomaintransferbasedapproachforunsupervisedthermalimagesuperresolution
AT sappaangeld noveldomaintransferbasedapproachforunsupervisedthermalimagesuperresolution
AT vintimillaborisx noveldomaintransferbasedapproachforunsupervisedthermalimagesuperresolution
AT hammoudriad noveldomaintransferbasedapproachforunsupervisedthermalimagesuperresolution