Cargando…
Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network
Low-light image enhancement can effectively assist high-level vision tasks that often fail in poor illumination conditions. Most previous data-driven methods, however, implemented enhancement directly from severely degraded low-light images that may provide undesirable enhancement results, including...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9505311/ https://www.ncbi.nlm.nih.gov/pubmed/36146148 http://dx.doi.org/10.3390/s22186799 |
_version_ | 1784796440838537216 |
---|---|
author | Ye, Jing Chen, Xintao Qiu, Changzhen Zhang, Zhiyong |
author_facet | Ye, Jing Chen, Xintao Qiu, Changzhen Zhang, Zhiyong |
author_sort | Ye, Jing |
collection | PubMed |
description | Low-light image enhancement can effectively assist high-level vision tasks that often fail in poor illumination conditions. Most previous data-driven methods, however, implemented enhancement directly from severely degraded low-light images that may provide undesirable enhancement results, including blurred detail, intensive noise, and distorted color. In this paper, inspired by a coarse-to-fine strategy, we propose an end-to-end image-level alignment with pixel-wise perceptual information enhancement pipeline for low-light image enhancement. A coarse adaptive global photometric alignment sub-network is constructed to reduce style differences, which facilitates improving illumination and revealing under-exposure area information. After the learned aligned image, a hierarchy pyramid enhancement sub-network is used to optimize image quality, which helps to remove amplified noise and enhance the local detail of low-light images. We also propose a multi-residual cascade attention block (MRCAB) that involves channel split and concatenation strategy, polarized self-attention mechanism, which leads to high-resolution reconstruction images in perceptual quality. Extensive experiments have demonstrated the effectiveness of our method on various datasets and significantly outperformed other state-of-the-art methods in detail and color reproduction. |
format | Online Article Text |
id | pubmed-9505311 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-95053112022-09-24 Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network Ye, Jing Chen, Xintao Qiu, Changzhen Zhang, Zhiyong Sensors (Basel) Article Low-light image enhancement can effectively assist high-level vision tasks that often fail in poor illumination conditions. Most previous data-driven methods, however, implemented enhancement directly from severely degraded low-light images that may provide undesirable enhancement results, including blurred detail, intensive noise, and distorted color. In this paper, inspired by a coarse-to-fine strategy, we propose an end-to-end image-level alignment with pixel-wise perceptual information enhancement pipeline for low-light image enhancement. A coarse adaptive global photometric alignment sub-network is constructed to reduce style differences, which facilitates improving illumination and revealing under-exposure area information. After the learned aligned image, a hierarchy pyramid enhancement sub-network is used to optimize image quality, which helps to remove amplified noise and enhance the local detail of low-light images. We also propose a multi-residual cascade attention block (MRCAB) that involves channel split and concatenation strategy, polarized self-attention mechanism, which leads to high-resolution reconstruction images in perceptual quality. Extensive experiments have demonstrated the effectiveness of our method on various datasets and significantly outperformed other state-of-the-art methods in detail and color reproduction. MDPI 2022-09-08 /pmc/articles/PMC9505311/ /pubmed/36146148 http://dx.doi.org/10.3390/s22186799 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Ye, Jing Chen, Xintao Qiu, Changzhen Zhang, Zhiyong Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network |
title | Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network |
title_full | Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network |
title_fullStr | Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network |
title_full_unstemmed | Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network |
title_short | Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network |
title_sort | low-light image enhancement using photometric alignment with hierarchy pyramid network |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9505311/ https://www.ncbi.nlm.nih.gov/pubmed/36146148 http://dx.doi.org/10.3390/s22186799 |
work_keys_str_mv | AT yejing lowlightimageenhancementusingphotometricalignmentwithhierarchypyramidnetwork AT chenxintao lowlightimageenhancementusingphotometricalignmentwithhierarchypyramidnetwork AT qiuchangzhen lowlightimageenhancementusingphotometricalignmentwithhierarchypyramidnetwork AT zhangzhiyong lowlightimageenhancementusingphotometricalignmentwithhierarchypyramidnetwork |