Cargando…

Dual-color space network with global priors for photo retouching

There have been growing trends using deep learning-based approaches for photo retouching which aims to enhance unattractive images and make them visually appealing. However, the existing methods only considered the RGB color space, which limited the available color information for editing. To addres...

Descripción completa

Detalles Bibliográficos
Autores principales: Park, Pilseo, Oh, Heungmin, Kim, Hyuncheol
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10643665/
https://www.ncbi.nlm.nih.gov/pubmed/37957352
http://dx.doi.org/10.1038/s41598-023-47186-6
_version_ 1785147147884167168
author Park, Pilseo
Oh, Heungmin
Kim, Hyuncheol
author_facet Park, Pilseo
Oh, Heungmin
Kim, Hyuncheol
author_sort Park, Pilseo
collection PubMed
description There have been growing trends using deep learning-based approaches for photo retouching which aims to enhance unattractive images and make them visually appealing. However, the existing methods only considered the RGB color space, which limited the available color information for editing. To address this issue, we propose a dual-color space network that extracts color representations from multiple color spaces to provide more robust color information. Our approach is based on the observation that converting an image to a different color space generates a new image that can be further processed by a neural network. Hence, we utilize two separate networks: a transitional network and a base network, each operating in a different color space. Specifically, the input RGB image is converted to another color space (e.g., YCbCr) using color space converter (CSC). The resulting image is then passed through the transitional network to extract color representations from the corresponding color space using color prediction module (CPM). The output of the transitional network is converted back to the RGB space and fed into the base network, which operates in RGB space. By utilizing global priors from each representation in different color spaces, we guide the retouching process to produce natural and realistic results. Experimental results demonstrate that our proposed method outperforms state-of-the-art methods on the MIT-Adobe FiveK dataset, and an in-depth analysis and ablation study highlight the advantages of our approach.
format Online
Article
Text
id pubmed-10643665
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-106436652023-11-13 Dual-color space network with global priors for photo retouching Park, Pilseo Oh, Heungmin Kim, Hyuncheol Sci Rep Article There have been growing trends using deep learning-based approaches for photo retouching which aims to enhance unattractive images and make them visually appealing. However, the existing methods only considered the RGB color space, which limited the available color information for editing. To address this issue, we propose a dual-color space network that extracts color representations from multiple color spaces to provide more robust color information. Our approach is based on the observation that converting an image to a different color space generates a new image that can be further processed by a neural network. Hence, we utilize two separate networks: a transitional network and a base network, each operating in a different color space. Specifically, the input RGB image is converted to another color space (e.g., YCbCr) using color space converter (CSC). The resulting image is then passed through the transitional network to extract color representations from the corresponding color space using color prediction module (CPM). The output of the transitional network is converted back to the RGB space and fed into the base network, which operates in RGB space. By utilizing global priors from each representation in different color spaces, we guide the retouching process to produce natural and realistic results. Experimental results demonstrate that our proposed method outperforms state-of-the-art methods on the MIT-Adobe FiveK dataset, and an in-depth analysis and ablation study highlight the advantages of our approach. Nature Publishing Group UK 2023-11-13 /pmc/articles/PMC10643665/ /pubmed/37957352 http://dx.doi.org/10.1038/s41598-023-47186-6 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Park, Pilseo
Oh, Heungmin
Kim, Hyuncheol
Dual-color space network with global priors for photo retouching
title Dual-color space network with global priors for photo retouching
title_full Dual-color space network with global priors for photo retouching
title_fullStr Dual-color space network with global priors for photo retouching
title_full_unstemmed Dual-color space network with global priors for photo retouching
title_short Dual-color space network with global priors for photo retouching
title_sort dual-color space network with global priors for photo retouching
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10643665/
https://www.ncbi.nlm.nih.gov/pubmed/37957352
http://dx.doi.org/10.1038/s41598-023-47186-6
work_keys_str_mv AT parkpilseo dualcolorspacenetworkwithglobalpriorsforphotoretouching
AT ohheungmin dualcolorspacenetworkwithglobalpriorsforphotoretouching
AT kimhyuncheol dualcolorspacenetworkwithglobalpriorsforphotoretouching