Cargando…
Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction
As one of the key requirements for underwater exploration, underwater depth map estimation is of great importance in underwater vision research. Although significant progress has been achieved in the fields of image-to-image translation and depth map estimation, a gap between normal depth map estima...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8126016/ https://www.ncbi.nlm.nih.gov/pubmed/34065106 http://dx.doi.org/10.3390/s21093268 |
_version_ | 1783693674095312896 |
---|---|
author | Zhao, Qi Xin, Zhichao Yu, Zhibin Zheng, Bing |
author_facet | Zhao, Qi Xin, Zhichao Yu, Zhibin Zheng, Bing |
author_sort | Zhao, Qi |
collection | PubMed |
description | As one of the key requirements for underwater exploration, underwater depth map estimation is of great importance in underwater vision research. Although significant progress has been achieved in the fields of image-to-image translation and depth map estimation, a gap between normal depth map estimation and underwater depth map estimation still remains. Additionally, it is a great challenge to build a mapping function that converts a single underwater image into an underwater depth map due to the lack of paired data. Moreover, the ever-changing underwater environment further intensifies the difficulty of finding an optimal mapping solution. To eliminate these bottlenecks, we developed a novel image-to-image framework for underwater image synthesis and depth map estimation in underwater conditions. For the problem of the lack of paired data, by translating hazy in-air images (with a depth map) into underwater images, we initially obtained a paired dataset of underwater images and corresponding depth maps. To enrich our synthesized underwater dataset, we further translated hazy in-air images into a series of continuously changing underwater images with a specified style. For the depth map estimation, we included a coarse-to-fine network to provide a precise depth map estimation result. We evaluated the efficiency of our framework for a real underwater RGB-D dataset. The experimental results show that our method can provide a diversity of underwater images and the best depth map estimation precision. |
format | Online Article Text |
id | pubmed-8126016 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-81260162021-05-17 Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction Zhao, Qi Xin, Zhichao Yu, Zhibin Zheng, Bing Sensors (Basel) Communication As one of the key requirements for underwater exploration, underwater depth map estimation is of great importance in underwater vision research. Although significant progress has been achieved in the fields of image-to-image translation and depth map estimation, a gap between normal depth map estimation and underwater depth map estimation still remains. Additionally, it is a great challenge to build a mapping function that converts a single underwater image into an underwater depth map due to the lack of paired data. Moreover, the ever-changing underwater environment further intensifies the difficulty of finding an optimal mapping solution. To eliminate these bottlenecks, we developed a novel image-to-image framework for underwater image synthesis and depth map estimation in underwater conditions. For the problem of the lack of paired data, by translating hazy in-air images (with a depth map) into underwater images, we initially obtained a paired dataset of underwater images and corresponding depth maps. To enrich our synthesized underwater dataset, we further translated hazy in-air images into a series of continuously changing underwater images with a specified style. For the depth map estimation, we included a coarse-to-fine network to provide a precise depth map estimation result. We evaluated the efficiency of our framework for a real underwater RGB-D dataset. The experimental results show that our method can provide a diversity of underwater images and the best depth map estimation precision. MDPI 2021-05-09 /pmc/articles/PMC8126016/ /pubmed/34065106 http://dx.doi.org/10.3390/s21093268 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Communication Zhao, Qi Xin, Zhichao Yu, Zhibin Zheng, Bing Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction |
title | Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction |
title_full | Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction |
title_fullStr | Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction |
title_full_unstemmed | Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction |
title_short | Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction |
title_sort | unpaired underwater image synthesis with a disentangled representation for underwater depth map prediction |
topic | Communication |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8126016/ https://www.ncbi.nlm.nih.gov/pubmed/34065106 http://dx.doi.org/10.3390/s21093268 |
work_keys_str_mv | AT zhaoqi unpairedunderwaterimagesynthesiswithadisentangledrepresentationforunderwaterdepthmapprediction AT xinzhichao unpairedunderwaterimagesynthesiswithadisentangledrepresentationforunderwaterdepthmapprediction AT yuzhibin unpairedunderwaterimagesynthesiswithadisentangledrepresentationforunderwaterdepthmapprediction AT zhengbing unpairedunderwaterimagesynthesiswithadisentangledrepresentationforunderwaterdepthmapprediction |