Cargando…

CUI-Net: a correcting uneven illumination net for low-light image enhancement

Uneven lighting conditions often occur during real-life photography, such as images taken at night that may have both low-light dark areas and high-light overexposed areas. Traditional algorithms for enhancing low-light areas also increase the brightness of overexposed areas, affecting the overall v...

Descripción completa

Detalles Bibliográficos
Autores principales: Chao, Ke, Song, Wei, Shao, Sen, Liu, Dan, Liu, Xiangchun, Zhao, XiaoBing
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10412593/
https://www.ncbi.nlm.nih.gov/pubmed/37558723
http://dx.doi.org/10.1038/s41598-023-39524-5
_version_ 1785086944841039872
author Chao, Ke
Song, Wei
Shao, Sen
Liu, Dan
Liu, Xiangchun
Zhao, XiaoBing
author_facet Chao, Ke
Song, Wei
Shao, Sen
Liu, Dan
Liu, Xiangchun
Zhao, XiaoBing
author_sort Chao, Ke
collection PubMed
description Uneven lighting conditions often occur during real-life photography, such as images taken at night that may have both low-light dark areas and high-light overexposed areas. Traditional algorithms for enhancing low-light areas also increase the brightness of overexposed areas, affecting the overall visual effect of the image. Therefore, it is important to achieve differentiated enhancement of low-light and high-light areas. In this paper, we propose a network called correcting uneven illumination network (CUI-Net) with sparse attention transformer and convolutional neural network (CNN) to better extract low-light features by constraining high-light features. Specifically, CUI-Net consists of two main modules: a low-light enhancement module and an auxiliary module. The enhancement module is a hybrid network that combines the advantages of CNN and Transformer network, which can alleviate uneven lighting problems and enhance local details better. The auxiliary module is used to converge the enhancement results of multiple enhancement modules during the training phase, so that only one enhancement module is needed during the testing phase to speed up inference. Furthermore, zero-shot learning is used in this paper to adapt to complex uneven lighting environments without requiring paired or unpaired training data. Finally, to validate the effectiveness of the algorithm, we tested it on multiple datasets of different types, and the algorithm showed stable performance, demonstrating its good robustness. Additionally, by applying this algorithm to practical visual tasks such as object detection, face detection, and semantic segmentation, and comparing it with other state-of-the-art low-light image enhancement algorithms, we have demonstrated its practicality and advantages.
format Online
Article
Text
id pubmed-10412593
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-104125932023-08-11 CUI-Net: a correcting uneven illumination net for low-light image enhancement Chao, Ke Song, Wei Shao, Sen Liu, Dan Liu, Xiangchun Zhao, XiaoBing Sci Rep Article Uneven lighting conditions often occur during real-life photography, such as images taken at night that may have both low-light dark areas and high-light overexposed areas. Traditional algorithms for enhancing low-light areas also increase the brightness of overexposed areas, affecting the overall visual effect of the image. Therefore, it is important to achieve differentiated enhancement of low-light and high-light areas. In this paper, we propose a network called correcting uneven illumination network (CUI-Net) with sparse attention transformer and convolutional neural network (CNN) to better extract low-light features by constraining high-light features. Specifically, CUI-Net consists of two main modules: a low-light enhancement module and an auxiliary module. The enhancement module is a hybrid network that combines the advantages of CNN and Transformer network, which can alleviate uneven lighting problems and enhance local details better. The auxiliary module is used to converge the enhancement results of multiple enhancement modules during the training phase, so that only one enhancement module is needed during the testing phase to speed up inference. Furthermore, zero-shot learning is used in this paper to adapt to complex uneven lighting environments without requiring paired or unpaired training data. Finally, to validate the effectiveness of the algorithm, we tested it on multiple datasets of different types, and the algorithm showed stable performance, demonstrating its good robustness. Additionally, by applying this algorithm to practical visual tasks such as object detection, face detection, and semantic segmentation, and comparing it with other state-of-the-art low-light image enhancement algorithms, we have demonstrated its practicality and advantages. Nature Publishing Group UK 2023-08-09 /pmc/articles/PMC10412593/ /pubmed/37558723 http://dx.doi.org/10.1038/s41598-023-39524-5 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Chao, Ke
Song, Wei
Shao, Sen
Liu, Dan
Liu, Xiangchun
Zhao, XiaoBing
CUI-Net: a correcting uneven illumination net for low-light image enhancement
title CUI-Net: a correcting uneven illumination net for low-light image enhancement
title_full CUI-Net: a correcting uneven illumination net for low-light image enhancement
title_fullStr CUI-Net: a correcting uneven illumination net for low-light image enhancement
title_full_unstemmed CUI-Net: a correcting uneven illumination net for low-light image enhancement
title_short CUI-Net: a correcting uneven illumination net for low-light image enhancement
title_sort cui-net: a correcting uneven illumination net for low-light image enhancement
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10412593/
https://www.ncbi.nlm.nih.gov/pubmed/37558723
http://dx.doi.org/10.1038/s41598-023-39524-5
work_keys_str_mv AT chaoke cuinetacorrectingunevenilluminationnetforlowlightimageenhancement
AT songwei cuinetacorrectingunevenilluminationnetforlowlightimageenhancement
AT shaosen cuinetacorrectingunevenilluminationnetforlowlightimageenhancement
AT liudan cuinetacorrectingunevenilluminationnetforlowlightimageenhancement
AT liuxiangchun cuinetacorrectingunevenilluminationnetforlowlightimageenhancement
AT zhaoxiaobing cuinetacorrectingunevenilluminationnetforlowlightimageenhancement