Cargando…

Frequency-domain loss function for deep exposure correction of dark images

We address the problem of exposure correction of dark, blurry and noisy images captured in low-light conditions in the wild. Classical image-denoising filters work well in the frequency space but are constrained by several factors such as the correct choice of thresholds and frequency estimates. On...

Descripción completa

Detalles Bibliográficos
Autores principales: Yadav, Ojasvi, Ghosal, Koustav, Lutz, Sebastian, Smolic, Aljosa
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer London 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8549936/
https://www.ncbi.nlm.nih.gov/pubmed/34721702
http://dx.doi.org/10.1007/s11760-021-01915-4
_version_ 1784590857190506496
author Yadav, Ojasvi
Ghosal, Koustav
Lutz, Sebastian
Smolic, Aljosa
author_facet Yadav, Ojasvi
Ghosal, Koustav
Lutz, Sebastian
Smolic, Aljosa
author_sort Yadav, Ojasvi
collection PubMed
description We address the problem of exposure correction of dark, blurry and noisy images captured in low-light conditions in the wild. Classical image-denoising filters work well in the frequency space but are constrained by several factors such as the correct choice of thresholds and frequency estimates. On the other hand, traditional deep networks are trained end to end in the RGB space by formulating this task as an image translation problem. However, that is done without any explicit constraints on the inherent noise of the dark images and thus produces noisy and blurry outputs. To this end, we propose a DCT/FFT-based multi-scale loss function, which when combined with traditional losses, trains a network to translate the important features for visually pleasing output. Our loss function is end to end differentiable, scale-agnostic and generic; i.e., it can be applied to both RAW and JPEG images in most existing frameworks without additional overhead. Using this loss function, we report significant improvements over the state of the art using quantitative metrics and subjective tests.
format Online
Article
Text
id pubmed-8549936
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Springer London
record_format MEDLINE/PubMed
spelling pubmed-85499362021-10-29 Frequency-domain loss function for deep exposure correction of dark images Yadav, Ojasvi Ghosal, Koustav Lutz, Sebastian Smolic, Aljosa Signal Image Video Process Original Paper We address the problem of exposure correction of dark, blurry and noisy images captured in low-light conditions in the wild. Classical image-denoising filters work well in the frequency space but are constrained by several factors such as the correct choice of thresholds and frequency estimates. On the other hand, traditional deep networks are trained end to end in the RGB space by formulating this task as an image translation problem. However, that is done without any explicit constraints on the inherent noise of the dark images and thus produces noisy and blurry outputs. To this end, we propose a DCT/FFT-based multi-scale loss function, which when combined with traditional losses, trains a network to translate the important features for visually pleasing output. Our loss function is end to end differentiable, scale-agnostic and generic; i.e., it can be applied to both RAW and JPEG images in most existing frameworks without additional overhead. Using this loss function, we report significant improvements over the state of the art using quantitative metrics and subjective tests. Springer London 2021-05-15 2021 /pmc/articles/PMC8549936/ /pubmed/34721702 http://dx.doi.org/10.1007/s11760-021-01915-4 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Original Paper
Yadav, Ojasvi
Ghosal, Koustav
Lutz, Sebastian
Smolic, Aljosa
Frequency-domain loss function for deep exposure correction of dark images
title Frequency-domain loss function for deep exposure correction of dark images
title_full Frequency-domain loss function for deep exposure correction of dark images
title_fullStr Frequency-domain loss function for deep exposure correction of dark images
title_full_unstemmed Frequency-domain loss function for deep exposure correction of dark images
title_short Frequency-domain loss function for deep exposure correction of dark images
title_sort frequency-domain loss function for deep exposure correction of dark images
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8549936/
https://www.ncbi.nlm.nih.gov/pubmed/34721702
http://dx.doi.org/10.1007/s11760-021-01915-4
work_keys_str_mv AT yadavojasvi frequencydomainlossfunctionfordeepexposurecorrectionofdarkimages
AT ghosalkoustav frequencydomainlossfunctionfordeepexposurecorrectionofdarkimages
AT lutzsebastian frequencydomainlossfunctionfordeepexposurecorrectionofdarkimages
AT smolicaljosa frequencydomainlossfunctionfordeepexposurecorrectionofdarkimages