Cargando…
CUI-Net: a correcting uneven illumination net for low-light image enhancement
Uneven lighting conditions often occur during real-life photography, such as images taken at night that may have both low-light dark areas and high-light overexposed areas. Traditional algorithms for enhancing low-light areas also increase the brightness of overexposed areas, affecting the overall v...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10412593/ https://www.ncbi.nlm.nih.gov/pubmed/37558723 http://dx.doi.org/10.1038/s41598-023-39524-5 |
_version_ | 1785086944841039872 |
---|---|
author | Chao, Ke Song, Wei Shao, Sen Liu, Dan Liu, Xiangchun Zhao, XiaoBing |
author_facet | Chao, Ke Song, Wei Shao, Sen Liu, Dan Liu, Xiangchun Zhao, XiaoBing |
author_sort | Chao, Ke |
collection | PubMed |
description | Uneven lighting conditions often occur during real-life photography, such as images taken at night that may have both low-light dark areas and high-light overexposed areas. Traditional algorithms for enhancing low-light areas also increase the brightness of overexposed areas, affecting the overall visual effect of the image. Therefore, it is important to achieve differentiated enhancement of low-light and high-light areas. In this paper, we propose a network called correcting uneven illumination network (CUI-Net) with sparse attention transformer and convolutional neural network (CNN) to better extract low-light features by constraining high-light features. Specifically, CUI-Net consists of two main modules: a low-light enhancement module and an auxiliary module. The enhancement module is a hybrid network that combines the advantages of CNN and Transformer network, which can alleviate uneven lighting problems and enhance local details better. The auxiliary module is used to converge the enhancement results of multiple enhancement modules during the training phase, so that only one enhancement module is needed during the testing phase to speed up inference. Furthermore, zero-shot learning is used in this paper to adapt to complex uneven lighting environments without requiring paired or unpaired training data. Finally, to validate the effectiveness of the algorithm, we tested it on multiple datasets of different types, and the algorithm showed stable performance, demonstrating its good robustness. Additionally, by applying this algorithm to practical visual tasks such as object detection, face detection, and semantic segmentation, and comparing it with other state-of-the-art low-light image enhancement algorithms, we have demonstrated its practicality and advantages. |
format | Online Article Text |
id | pubmed-10412593 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-104125932023-08-11 CUI-Net: a correcting uneven illumination net for low-light image enhancement Chao, Ke Song, Wei Shao, Sen Liu, Dan Liu, Xiangchun Zhao, XiaoBing Sci Rep Article Uneven lighting conditions often occur during real-life photography, such as images taken at night that may have both low-light dark areas and high-light overexposed areas. Traditional algorithms for enhancing low-light areas also increase the brightness of overexposed areas, affecting the overall visual effect of the image. Therefore, it is important to achieve differentiated enhancement of low-light and high-light areas. In this paper, we propose a network called correcting uneven illumination network (CUI-Net) with sparse attention transformer and convolutional neural network (CNN) to better extract low-light features by constraining high-light features. Specifically, CUI-Net consists of two main modules: a low-light enhancement module and an auxiliary module. The enhancement module is a hybrid network that combines the advantages of CNN and Transformer network, which can alleviate uneven lighting problems and enhance local details better. The auxiliary module is used to converge the enhancement results of multiple enhancement modules during the training phase, so that only one enhancement module is needed during the testing phase to speed up inference. Furthermore, zero-shot learning is used in this paper to adapt to complex uneven lighting environments without requiring paired or unpaired training data. Finally, to validate the effectiveness of the algorithm, we tested it on multiple datasets of different types, and the algorithm showed stable performance, demonstrating its good robustness. Additionally, by applying this algorithm to practical visual tasks such as object detection, face detection, and semantic segmentation, and comparing it with other state-of-the-art low-light image enhancement algorithms, we have demonstrated its practicality and advantages. Nature Publishing Group UK 2023-08-09 /pmc/articles/PMC10412593/ /pubmed/37558723 http://dx.doi.org/10.1038/s41598-023-39524-5 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Chao, Ke Song, Wei Shao, Sen Liu, Dan Liu, Xiangchun Zhao, XiaoBing CUI-Net: a correcting uneven illumination net for low-light image enhancement |
title | CUI-Net: a correcting uneven illumination net for low-light image enhancement |
title_full | CUI-Net: a correcting uneven illumination net for low-light image enhancement |
title_fullStr | CUI-Net: a correcting uneven illumination net for low-light image enhancement |
title_full_unstemmed | CUI-Net: a correcting uneven illumination net for low-light image enhancement |
title_short | CUI-Net: a correcting uneven illumination net for low-light image enhancement |
title_sort | cui-net: a correcting uneven illumination net for low-light image enhancement |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10412593/ https://www.ncbi.nlm.nih.gov/pubmed/37558723 http://dx.doi.org/10.1038/s41598-023-39524-5 |
work_keys_str_mv | AT chaoke cuinetacorrectingunevenilluminationnetforlowlightimageenhancement AT songwei cuinetacorrectingunevenilluminationnetforlowlightimageenhancement AT shaosen cuinetacorrectingunevenilluminationnetforlowlightimageenhancement AT liudan cuinetacorrectingunevenilluminationnetforlowlightimageenhancement AT liuxiangchun cuinetacorrectingunevenilluminationnetforlowlightimageenhancement AT zhaoxiaobing cuinetacorrectingunevenilluminationnetforlowlightimageenhancement |