Cargando…

Underwater Target Detection Utilizing Polarization Image Fusion Algorithm Based on Unsupervised Learning and Attention Mechanism

Since light propagation in water bodies is subject to absorption and scattering effects, underwater images using only conventional intensity cameras will suffer from low brightness, blurred images, and loss of details. In this paper, a deep fusion network is applied to underwater polarization images...

Descripción completa

Detalles Bibliográficos
Autores principales: Cheng, Haoyuan, Zhang, Deqing, Zhu, Jinchi, Yu, Hao, Chu, Jinkui
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10303408/
https://www.ncbi.nlm.nih.gov/pubmed/37420760
http://dx.doi.org/10.3390/s23125594
_version_ 1785065270592667648
author Cheng, Haoyuan
Zhang, Deqing
Zhu, Jinchi
Yu, Hao
Chu, Jinkui
author_facet Cheng, Haoyuan
Zhang, Deqing
Zhu, Jinchi
Yu, Hao
Chu, Jinkui
author_sort Cheng, Haoyuan
collection PubMed
description Since light propagation in water bodies is subject to absorption and scattering effects, underwater images using only conventional intensity cameras will suffer from low brightness, blurred images, and loss of details. In this paper, a deep fusion network is applied to underwater polarization images; that is, the underwater polarization images are fused with intensity images using the deep learning method. To construct a training dataset, we establish an experimental setup to obtain underwater polarization images and perform appropriate transformations to expand the dataset. Next, an end-to-end learning framework based on unsupervised learning and guided by an attention mechanism is constructed for fusing polarization and light intensity images. The loss function and weight parameters are elaborated. The produced dataset is used to train the network under different loss weight parameters, and the fused images are evaluated based on different image evaluation metrics. The results show that the fused underwater images are more detailed. Compared with light intensity images, the information entropy and standard deviation of the proposed method increase by 24.48% and 139%. The image processing results are better than other fusion-based methods. In addition, the improved U-net network structure is used to extract features for image segmentation. The results show that the target segmentation based on the proposed method is feasible under turbid water. The proposed method does not require manual adjustment of weight parameters, has faster operation speed, and has strong robustness and self-adaptability, which is important for research in vision fields, such as ocean detection and underwater target recognition.
format Online
Article
Text
id pubmed-10303408
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-103034082023-06-29 Underwater Target Detection Utilizing Polarization Image Fusion Algorithm Based on Unsupervised Learning and Attention Mechanism Cheng, Haoyuan Zhang, Deqing Zhu, Jinchi Yu, Hao Chu, Jinkui Sensors (Basel) Article Since light propagation in water bodies is subject to absorption and scattering effects, underwater images using only conventional intensity cameras will suffer from low brightness, blurred images, and loss of details. In this paper, a deep fusion network is applied to underwater polarization images; that is, the underwater polarization images are fused with intensity images using the deep learning method. To construct a training dataset, we establish an experimental setup to obtain underwater polarization images and perform appropriate transformations to expand the dataset. Next, an end-to-end learning framework based on unsupervised learning and guided by an attention mechanism is constructed for fusing polarization and light intensity images. The loss function and weight parameters are elaborated. The produced dataset is used to train the network under different loss weight parameters, and the fused images are evaluated based on different image evaluation metrics. The results show that the fused underwater images are more detailed. Compared with light intensity images, the information entropy and standard deviation of the proposed method increase by 24.48% and 139%. The image processing results are better than other fusion-based methods. In addition, the improved U-net network structure is used to extract features for image segmentation. The results show that the target segmentation based on the proposed method is feasible under turbid water. The proposed method does not require manual adjustment of weight parameters, has faster operation speed, and has strong robustness and self-adaptability, which is important for research in vision fields, such as ocean detection and underwater target recognition. MDPI 2023-06-15 /pmc/articles/PMC10303408/ /pubmed/37420760 http://dx.doi.org/10.3390/s23125594 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Cheng, Haoyuan
Zhang, Deqing
Zhu, Jinchi
Yu, Hao
Chu, Jinkui
Underwater Target Detection Utilizing Polarization Image Fusion Algorithm Based on Unsupervised Learning and Attention Mechanism
title Underwater Target Detection Utilizing Polarization Image Fusion Algorithm Based on Unsupervised Learning and Attention Mechanism
title_full Underwater Target Detection Utilizing Polarization Image Fusion Algorithm Based on Unsupervised Learning and Attention Mechanism
title_fullStr Underwater Target Detection Utilizing Polarization Image Fusion Algorithm Based on Unsupervised Learning and Attention Mechanism
title_full_unstemmed Underwater Target Detection Utilizing Polarization Image Fusion Algorithm Based on Unsupervised Learning and Attention Mechanism
title_short Underwater Target Detection Utilizing Polarization Image Fusion Algorithm Based on Unsupervised Learning and Attention Mechanism
title_sort underwater target detection utilizing polarization image fusion algorithm based on unsupervised learning and attention mechanism
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10303408/
https://www.ncbi.nlm.nih.gov/pubmed/37420760
http://dx.doi.org/10.3390/s23125594
work_keys_str_mv AT chenghaoyuan underwatertargetdetectionutilizingpolarizationimagefusionalgorithmbasedonunsupervisedlearningandattentionmechanism
AT zhangdeqing underwatertargetdetectionutilizingpolarizationimagefusionalgorithmbasedonunsupervisedlearningandattentionmechanism
AT zhujinchi underwatertargetdetectionutilizingpolarizationimagefusionalgorithmbasedonunsupervisedlearningandattentionmechanism
AT yuhao underwatertargetdetectionutilizingpolarizationimagefusionalgorithmbasedonunsupervisedlearningandattentionmechanism
AT chujinkui underwatertargetdetectionutilizingpolarizationimagefusionalgorithmbasedonunsupervisedlearningandattentionmechanism