Cargando…

Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution

Image super-resolution technique can improve image quality by increasing image clarity, bringing a better user experience in real production scenarios. However, existing convolutional neural network methods usually have very deep network layers and a large number of parameters, which causes feature...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Sufan, Chen, Xi, Huang, Xingwei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9529453/
https://www.ncbi.nlm.nih.gov/pubmed/36199958
http://dx.doi.org/10.1155/2022/8628402
_version_ 1784801497515556864
author Zhang, Sufan
Chen, Xi
Huang, Xingwei
author_facet Zhang, Sufan
Chen, Xi
Huang, Xingwei
author_sort Zhang, Sufan
collection PubMed
description Image super-resolution technique can improve image quality by increasing image clarity, bringing a better user experience in real production scenarios. However, existing convolutional neural network methods usually have very deep network layers and a large number of parameters, which causes feature information to be lost as the network deepens, and models with a large numbers of parameters are not suitable for deploying on resource-constrained mobile devices. To address the above problems, we propose a novel lightweight image super-resolution network (RepSCN) based on re-parameterization and self-calibration convolution. Specifically, to reduce the computational cost while capturing more high-frequency details, we designed a re-parameterization distillation block (RepDB) and a self-calibrated distillation block (SCDB). They can improve the reconstruction results by aggregating the local distilled feature information under different receptive fields without introducing extra parameters. On the other hand, the positional information of the image is also crucial for super-resolution reconstruction. Nevertheless, existing lightweight SR methods mainly adopt the channel attention mechanism, which ignores the importance of positional information. Therefore, we introduce a lightweight coordinate attention mechanism (CAM) at the end of RepDB and SCDB to enhance the feature representation at both spatial and channel levels. Numerous experiments have shown that our network has better reconstruction performance with reduced parameters than other classical lightweight super-resolution models.
format Online
Article
Text
id pubmed-9529453
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-95294532022-10-04 Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution Zhang, Sufan Chen, Xi Huang, Xingwei Comput Intell Neurosci Research Article Image super-resolution technique can improve image quality by increasing image clarity, bringing a better user experience in real production scenarios. However, existing convolutional neural network methods usually have very deep network layers and a large number of parameters, which causes feature information to be lost as the network deepens, and models with a large numbers of parameters are not suitable for deploying on resource-constrained mobile devices. To address the above problems, we propose a novel lightweight image super-resolution network (RepSCN) based on re-parameterization and self-calibration convolution. Specifically, to reduce the computational cost while capturing more high-frequency details, we designed a re-parameterization distillation block (RepDB) and a self-calibrated distillation block (SCDB). They can improve the reconstruction results by aggregating the local distilled feature information under different receptive fields without introducing extra parameters. On the other hand, the positional information of the image is also crucial for super-resolution reconstruction. Nevertheless, existing lightweight SR methods mainly adopt the channel attention mechanism, which ignores the importance of positional information. Therefore, we introduce a lightweight coordinate attention mechanism (CAM) at the end of RepDB and SCDB to enhance the feature representation at both spatial and channel levels. Numerous experiments have shown that our network has better reconstruction performance with reduced parameters than other classical lightweight super-resolution models. Hindawi 2022-09-26 /pmc/articles/PMC9529453/ /pubmed/36199958 http://dx.doi.org/10.1155/2022/8628402 Text en Copyright © 2022 Sufan Zhang et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Zhang, Sufan
Chen, Xi
Huang, Xingwei
Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution
title Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution
title_full Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution
title_fullStr Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution
title_full_unstemmed Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution
title_short Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution
title_sort lightweight image super-resolution based on re-parameterization and self-calibrated convolution
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9529453/
https://www.ncbi.nlm.nih.gov/pubmed/36199958
http://dx.doi.org/10.1155/2022/8628402
work_keys_str_mv AT zhangsufan lightweightimagesuperresolutionbasedonreparameterizationandselfcalibratedconvolution
AT chenxi lightweightimagesuperresolutionbasedonreparameterizationandselfcalibratedconvolution
AT huangxingwei lightweightimagesuperresolutionbasedonreparameterizationandselfcalibratedconvolution