Cargando…
Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution
Image super-resolution technique can improve image quality by increasing image clarity, bringing a better user experience in real production scenarios. However, existing convolutional neural network methods usually have very deep network layers and a large number of parameters, which causes feature...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Hindawi
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9529453/ https://www.ncbi.nlm.nih.gov/pubmed/36199958 http://dx.doi.org/10.1155/2022/8628402 |
_version_ | 1784801497515556864 |
---|---|
author | Zhang, Sufan Chen, Xi Huang, Xingwei |
author_facet | Zhang, Sufan Chen, Xi Huang, Xingwei |
author_sort | Zhang, Sufan |
collection | PubMed |
description | Image super-resolution technique can improve image quality by increasing image clarity, bringing a better user experience in real production scenarios. However, existing convolutional neural network methods usually have very deep network layers and a large number of parameters, which causes feature information to be lost as the network deepens, and models with a large numbers of parameters are not suitable for deploying on resource-constrained mobile devices. To address the above problems, we propose a novel lightweight image super-resolution network (RepSCN) based on re-parameterization and self-calibration convolution. Specifically, to reduce the computational cost while capturing more high-frequency details, we designed a re-parameterization distillation block (RepDB) and a self-calibrated distillation block (SCDB). They can improve the reconstruction results by aggregating the local distilled feature information under different receptive fields without introducing extra parameters. On the other hand, the positional information of the image is also crucial for super-resolution reconstruction. Nevertheless, existing lightweight SR methods mainly adopt the channel attention mechanism, which ignores the importance of positional information. Therefore, we introduce a lightweight coordinate attention mechanism (CAM) at the end of RepDB and SCDB to enhance the feature representation at both spatial and channel levels. Numerous experiments have shown that our network has better reconstruction performance with reduced parameters than other classical lightweight super-resolution models. |
format | Online Article Text |
id | pubmed-9529453 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Hindawi |
record_format | MEDLINE/PubMed |
spelling | pubmed-95294532022-10-04 Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution Zhang, Sufan Chen, Xi Huang, Xingwei Comput Intell Neurosci Research Article Image super-resolution technique can improve image quality by increasing image clarity, bringing a better user experience in real production scenarios. However, existing convolutional neural network methods usually have very deep network layers and a large number of parameters, which causes feature information to be lost as the network deepens, and models with a large numbers of parameters are not suitable for deploying on resource-constrained mobile devices. To address the above problems, we propose a novel lightweight image super-resolution network (RepSCN) based on re-parameterization and self-calibration convolution. Specifically, to reduce the computational cost while capturing more high-frequency details, we designed a re-parameterization distillation block (RepDB) and a self-calibrated distillation block (SCDB). They can improve the reconstruction results by aggregating the local distilled feature information under different receptive fields without introducing extra parameters. On the other hand, the positional information of the image is also crucial for super-resolution reconstruction. Nevertheless, existing lightweight SR methods mainly adopt the channel attention mechanism, which ignores the importance of positional information. Therefore, we introduce a lightweight coordinate attention mechanism (CAM) at the end of RepDB and SCDB to enhance the feature representation at both spatial and channel levels. Numerous experiments have shown that our network has better reconstruction performance with reduced parameters than other classical lightweight super-resolution models. Hindawi 2022-09-26 /pmc/articles/PMC9529453/ /pubmed/36199958 http://dx.doi.org/10.1155/2022/8628402 Text en Copyright © 2022 Sufan Zhang et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Article Zhang, Sufan Chen, Xi Huang, Xingwei Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution |
title | Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution |
title_full | Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution |
title_fullStr | Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution |
title_full_unstemmed | Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution |
title_short | Lightweight Image Super-Resolution Based on Re-Parameterization and Self-Calibrated Convolution |
title_sort | lightweight image super-resolution based on re-parameterization and self-calibrated convolution |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9529453/ https://www.ncbi.nlm.nih.gov/pubmed/36199958 http://dx.doi.org/10.1155/2022/8628402 |
work_keys_str_mv | AT zhangsufan lightweightimagesuperresolutionbasedonreparameterizationandselfcalibratedconvolution AT chenxi lightweightimagesuperresolutionbasedonreparameterizationandselfcalibratedconvolution AT huangxingwei lightweightimagesuperresolutionbasedonreparameterizationandselfcalibratedconvolution |