Cargando…

Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction

As one of the key requirements for underwater exploration, underwater depth map estimation is of great importance in underwater vision research. Although significant progress has been achieved in the fields of image-to-image translation and depth map estimation, a gap between normal depth map estima...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhao, Qi, Xin, Zhichao, Yu, Zhibin, Zheng, Bing
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8126016/
https://www.ncbi.nlm.nih.gov/pubmed/34065106
http://dx.doi.org/10.3390/s21093268
_version_ 1783693674095312896
author Zhao, Qi
Xin, Zhichao
Yu, Zhibin
Zheng, Bing
author_facet Zhao, Qi
Xin, Zhichao
Yu, Zhibin
Zheng, Bing
author_sort Zhao, Qi
collection PubMed
description As one of the key requirements for underwater exploration, underwater depth map estimation is of great importance in underwater vision research. Although significant progress has been achieved in the fields of image-to-image translation and depth map estimation, a gap between normal depth map estimation and underwater depth map estimation still remains. Additionally, it is a great challenge to build a mapping function that converts a single underwater image into an underwater depth map due to the lack of paired data. Moreover, the ever-changing underwater environment further intensifies the difficulty of finding an optimal mapping solution. To eliminate these bottlenecks, we developed a novel image-to-image framework for underwater image synthesis and depth map estimation in underwater conditions. For the problem of the lack of paired data, by translating hazy in-air images (with a depth map) into underwater images, we initially obtained a paired dataset of underwater images and corresponding depth maps. To enrich our synthesized underwater dataset, we further translated hazy in-air images into a series of continuously changing underwater images with a specified style. For the depth map estimation, we included a coarse-to-fine network to provide a precise depth map estimation result. We evaluated the efficiency of our framework for a real underwater RGB-D dataset. The experimental results show that our method can provide a diversity of underwater images and the best depth map estimation precision.
format Online
Article
Text
id pubmed-8126016
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-81260162021-05-17 Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction Zhao, Qi Xin, Zhichao Yu, Zhibin Zheng, Bing Sensors (Basel) Communication As one of the key requirements for underwater exploration, underwater depth map estimation is of great importance in underwater vision research. Although significant progress has been achieved in the fields of image-to-image translation and depth map estimation, a gap between normal depth map estimation and underwater depth map estimation still remains. Additionally, it is a great challenge to build a mapping function that converts a single underwater image into an underwater depth map due to the lack of paired data. Moreover, the ever-changing underwater environment further intensifies the difficulty of finding an optimal mapping solution. To eliminate these bottlenecks, we developed a novel image-to-image framework for underwater image synthesis and depth map estimation in underwater conditions. For the problem of the lack of paired data, by translating hazy in-air images (with a depth map) into underwater images, we initially obtained a paired dataset of underwater images and corresponding depth maps. To enrich our synthesized underwater dataset, we further translated hazy in-air images into a series of continuously changing underwater images with a specified style. For the depth map estimation, we included a coarse-to-fine network to provide a precise depth map estimation result. We evaluated the efficiency of our framework for a real underwater RGB-D dataset. The experimental results show that our method can provide a diversity of underwater images and the best depth map estimation precision. MDPI 2021-05-09 /pmc/articles/PMC8126016/ /pubmed/34065106 http://dx.doi.org/10.3390/s21093268 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Communication
Zhao, Qi
Xin, Zhichao
Yu, Zhibin
Zheng, Bing
Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction
title Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction
title_full Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction
title_fullStr Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction
title_full_unstemmed Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction
title_short Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction
title_sort unpaired underwater image synthesis with a disentangled representation for underwater depth map prediction
topic Communication
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8126016/
https://www.ncbi.nlm.nih.gov/pubmed/34065106
http://dx.doi.org/10.3390/s21093268
work_keys_str_mv AT zhaoqi unpairedunderwaterimagesynthesiswithadisentangledrepresentationforunderwaterdepthmapprediction
AT xinzhichao unpairedunderwaterimagesynthesiswithadisentangledrepresentationforunderwaterdepthmapprediction
AT yuzhibin unpairedunderwaterimagesynthesiswithadisentangledrepresentationforunderwaterdepthmapprediction
AT zhengbing unpairedunderwaterimagesynthesiswithadisentangledrepresentationforunderwaterdepthmapprediction