Cargando…
Frequency-domain loss function for deep exposure correction of dark images
We address the problem of exposure correction of dark, blurry and noisy images captured in low-light conditions in the wild. Classical image-denoising filters work well in the frequency space but are constrained by several factors such as the correct choice of thresholds and frequency estimates. On...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer London
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8549936/ https://www.ncbi.nlm.nih.gov/pubmed/34721702 http://dx.doi.org/10.1007/s11760-021-01915-4 |
_version_ | 1784590857190506496 |
---|---|
author | Yadav, Ojasvi Ghosal, Koustav Lutz, Sebastian Smolic, Aljosa |
author_facet | Yadav, Ojasvi Ghosal, Koustav Lutz, Sebastian Smolic, Aljosa |
author_sort | Yadav, Ojasvi |
collection | PubMed |
description | We address the problem of exposure correction of dark, blurry and noisy images captured in low-light conditions in the wild. Classical image-denoising filters work well in the frequency space but are constrained by several factors such as the correct choice of thresholds and frequency estimates. On the other hand, traditional deep networks are trained end to end in the RGB space by formulating this task as an image translation problem. However, that is done without any explicit constraints on the inherent noise of the dark images and thus produces noisy and blurry outputs. To this end, we propose a DCT/FFT-based multi-scale loss function, which when combined with traditional losses, trains a network to translate the important features for visually pleasing output. Our loss function is end to end differentiable, scale-agnostic and generic; i.e., it can be applied to both RAW and JPEG images in most existing frameworks without additional overhead. Using this loss function, we report significant improvements over the state of the art using quantitative metrics and subjective tests. |
format | Online Article Text |
id | pubmed-8549936 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Springer London |
record_format | MEDLINE/PubMed |
spelling | pubmed-85499362021-10-29 Frequency-domain loss function for deep exposure correction of dark images Yadav, Ojasvi Ghosal, Koustav Lutz, Sebastian Smolic, Aljosa Signal Image Video Process Original Paper We address the problem of exposure correction of dark, blurry and noisy images captured in low-light conditions in the wild. Classical image-denoising filters work well in the frequency space but are constrained by several factors such as the correct choice of thresholds and frequency estimates. On the other hand, traditional deep networks are trained end to end in the RGB space by formulating this task as an image translation problem. However, that is done without any explicit constraints on the inherent noise of the dark images and thus produces noisy and blurry outputs. To this end, we propose a DCT/FFT-based multi-scale loss function, which when combined with traditional losses, trains a network to translate the important features for visually pleasing output. Our loss function is end to end differentiable, scale-agnostic and generic; i.e., it can be applied to both RAW and JPEG images in most existing frameworks without additional overhead. Using this loss function, we report significant improvements over the state of the art using quantitative metrics and subjective tests. Springer London 2021-05-15 2021 /pmc/articles/PMC8549936/ /pubmed/34721702 http://dx.doi.org/10.1007/s11760-021-01915-4 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Original Paper Yadav, Ojasvi Ghosal, Koustav Lutz, Sebastian Smolic, Aljosa Frequency-domain loss function for deep exposure correction of dark images |
title | Frequency-domain loss function for deep exposure correction of dark images |
title_full | Frequency-domain loss function for deep exposure correction of dark images |
title_fullStr | Frequency-domain loss function for deep exposure correction of dark images |
title_full_unstemmed | Frequency-domain loss function for deep exposure correction of dark images |
title_short | Frequency-domain loss function for deep exposure correction of dark images |
title_sort | frequency-domain loss function for deep exposure correction of dark images |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8549936/ https://www.ncbi.nlm.nih.gov/pubmed/34721702 http://dx.doi.org/10.1007/s11760-021-01915-4 |
work_keys_str_mv | AT yadavojasvi frequencydomainlossfunctionfordeepexposurecorrectionofdarkimages AT ghosalkoustav frequencydomainlossfunctionfordeepexposurecorrectionofdarkimages AT lutzsebastian frequencydomainlossfunctionfordeepexposurecorrectionofdarkimages AT smolicaljosa frequencydomainlossfunctionfordeepexposurecorrectionofdarkimages |