Cargando…
Dual-color space network with global priors for photo retouching
There have been growing trends using deep learning-based approaches for photo retouching which aims to enhance unattractive images and make them visually appealing. However, the existing methods only considered the RGB color space, which limited the available color information for editing. To addres...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10643665/ https://www.ncbi.nlm.nih.gov/pubmed/37957352 http://dx.doi.org/10.1038/s41598-023-47186-6 |
_version_ | 1785147147884167168 |
---|---|
author | Park, Pilseo Oh, Heungmin Kim, Hyuncheol |
author_facet | Park, Pilseo Oh, Heungmin Kim, Hyuncheol |
author_sort | Park, Pilseo |
collection | PubMed |
description | There have been growing trends using deep learning-based approaches for photo retouching which aims to enhance unattractive images and make them visually appealing. However, the existing methods only considered the RGB color space, which limited the available color information for editing. To address this issue, we propose a dual-color space network that extracts color representations from multiple color spaces to provide more robust color information. Our approach is based on the observation that converting an image to a different color space generates a new image that can be further processed by a neural network. Hence, we utilize two separate networks: a transitional network and a base network, each operating in a different color space. Specifically, the input RGB image is converted to another color space (e.g., YCbCr) using color space converter (CSC). The resulting image is then passed through the transitional network to extract color representations from the corresponding color space using color prediction module (CPM). The output of the transitional network is converted back to the RGB space and fed into the base network, which operates in RGB space. By utilizing global priors from each representation in different color spaces, we guide the retouching process to produce natural and realistic results. Experimental results demonstrate that our proposed method outperforms state-of-the-art methods on the MIT-Adobe FiveK dataset, and an in-depth analysis and ablation study highlight the advantages of our approach. |
format | Online Article Text |
id | pubmed-10643665 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-106436652023-11-13 Dual-color space network with global priors for photo retouching Park, Pilseo Oh, Heungmin Kim, Hyuncheol Sci Rep Article There have been growing trends using deep learning-based approaches for photo retouching which aims to enhance unattractive images and make them visually appealing. However, the existing methods only considered the RGB color space, which limited the available color information for editing. To address this issue, we propose a dual-color space network that extracts color representations from multiple color spaces to provide more robust color information. Our approach is based on the observation that converting an image to a different color space generates a new image that can be further processed by a neural network. Hence, we utilize two separate networks: a transitional network and a base network, each operating in a different color space. Specifically, the input RGB image is converted to another color space (e.g., YCbCr) using color space converter (CSC). The resulting image is then passed through the transitional network to extract color representations from the corresponding color space using color prediction module (CPM). The output of the transitional network is converted back to the RGB space and fed into the base network, which operates in RGB space. By utilizing global priors from each representation in different color spaces, we guide the retouching process to produce natural and realistic results. Experimental results demonstrate that our proposed method outperforms state-of-the-art methods on the MIT-Adobe FiveK dataset, and an in-depth analysis and ablation study highlight the advantages of our approach. Nature Publishing Group UK 2023-11-13 /pmc/articles/PMC10643665/ /pubmed/37957352 http://dx.doi.org/10.1038/s41598-023-47186-6 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Park, Pilseo Oh, Heungmin Kim, Hyuncheol Dual-color space network with global priors for photo retouching |
title | Dual-color space network with global priors for photo retouching |
title_full | Dual-color space network with global priors for photo retouching |
title_fullStr | Dual-color space network with global priors for photo retouching |
title_full_unstemmed | Dual-color space network with global priors for photo retouching |
title_short | Dual-color space network with global priors for photo retouching |
title_sort | dual-color space network with global priors for photo retouching |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10643665/ https://www.ncbi.nlm.nih.gov/pubmed/37957352 http://dx.doi.org/10.1038/s41598-023-47186-6 |
work_keys_str_mv | AT parkpilseo dualcolorspacenetworkwithglobalpriorsforphotoretouching AT ohheungmin dualcolorspacenetworkwithglobalpriorsforphotoretouching AT kimhyuncheol dualcolorspacenetworkwithglobalpriorsforphotoretouching |