Cargando…

Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network

Low-light image enhancement can effectively assist high-level vision tasks that often fail in poor illumination conditions. Most previous data-driven methods, however, implemented enhancement directly from severely degraded low-light images that may provide undesirable enhancement results, including...

Descripción completa

Detalles Bibliográficos
Autores principales: Ye, Jing, Chen, Xintao, Qiu, Changzhen, Zhang, Zhiyong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9505311/
https://www.ncbi.nlm.nih.gov/pubmed/36146148
http://dx.doi.org/10.3390/s22186799
_version_ 1784796440838537216
author Ye, Jing
Chen, Xintao
Qiu, Changzhen
Zhang, Zhiyong
author_facet Ye, Jing
Chen, Xintao
Qiu, Changzhen
Zhang, Zhiyong
author_sort Ye, Jing
collection PubMed
description Low-light image enhancement can effectively assist high-level vision tasks that often fail in poor illumination conditions. Most previous data-driven methods, however, implemented enhancement directly from severely degraded low-light images that may provide undesirable enhancement results, including blurred detail, intensive noise, and distorted color. In this paper, inspired by a coarse-to-fine strategy, we propose an end-to-end image-level alignment with pixel-wise perceptual information enhancement pipeline for low-light image enhancement. A coarse adaptive global photometric alignment sub-network is constructed to reduce style differences, which facilitates improving illumination and revealing under-exposure area information. After the learned aligned image, a hierarchy pyramid enhancement sub-network is used to optimize image quality, which helps to remove amplified noise and enhance the local detail of low-light images. We also propose a multi-residual cascade attention block (MRCAB) that involves channel split and concatenation strategy, polarized self-attention mechanism, which leads to high-resolution reconstruction images in perceptual quality. Extensive experiments have demonstrated the effectiveness of our method on various datasets and significantly outperformed other state-of-the-art methods in detail and color reproduction.
format Online
Article
Text
id pubmed-9505311
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-95053112022-09-24 Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network Ye, Jing Chen, Xintao Qiu, Changzhen Zhang, Zhiyong Sensors (Basel) Article Low-light image enhancement can effectively assist high-level vision tasks that often fail in poor illumination conditions. Most previous data-driven methods, however, implemented enhancement directly from severely degraded low-light images that may provide undesirable enhancement results, including blurred detail, intensive noise, and distorted color. In this paper, inspired by a coarse-to-fine strategy, we propose an end-to-end image-level alignment with pixel-wise perceptual information enhancement pipeline for low-light image enhancement. A coarse adaptive global photometric alignment sub-network is constructed to reduce style differences, which facilitates improving illumination and revealing under-exposure area information. After the learned aligned image, a hierarchy pyramid enhancement sub-network is used to optimize image quality, which helps to remove amplified noise and enhance the local detail of low-light images. We also propose a multi-residual cascade attention block (MRCAB) that involves channel split and concatenation strategy, polarized self-attention mechanism, which leads to high-resolution reconstruction images in perceptual quality. Extensive experiments have demonstrated the effectiveness of our method on various datasets and significantly outperformed other state-of-the-art methods in detail and color reproduction. MDPI 2022-09-08 /pmc/articles/PMC9505311/ /pubmed/36146148 http://dx.doi.org/10.3390/s22186799 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Ye, Jing
Chen, Xintao
Qiu, Changzhen
Zhang, Zhiyong
Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network
title Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network
title_full Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network
title_fullStr Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network
title_full_unstemmed Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network
title_short Low-Light Image Enhancement Using Photometric Alignment with Hierarchy Pyramid Network
title_sort low-light image enhancement using photometric alignment with hierarchy pyramid network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9505311/
https://www.ncbi.nlm.nih.gov/pubmed/36146148
http://dx.doi.org/10.3390/s22186799
work_keys_str_mv AT yejing lowlightimageenhancementusingphotometricalignmentwithhierarchypyramidnetwork
AT chenxintao lowlightimageenhancementusingphotometricalignmentwithhierarchypyramidnetwork
AT qiuchangzhen lowlightimageenhancementusingphotometricalignmentwithhierarchypyramidnetwork
AT zhangzhiyong lowlightimageenhancementusingphotometricalignmentwithhierarchypyramidnetwork