Cargando…

Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function

Depth estimation is a crucial component in many 3D vision applications. Monocular depth estimation is gaining increasing interest due to flexible use and extremely low system requirements, but inherently ill-posed and ambiguous characteristics still cause unsatisfactory estimation results. This pape...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Peng, Zhang, Zonghua, Meng, Zhaozong, Gao, Nan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7794707/
https://www.ncbi.nlm.nih.gov/pubmed/33374278
http://dx.doi.org/10.3390/s21010054
_version_ 1783634272217726976
author Liu, Peng
Zhang, Zonghua
Meng, Zhaozong
Gao, Nan
author_facet Liu, Peng
Zhang, Zonghua
Meng, Zhaozong
Gao, Nan
author_sort Liu, Peng
collection PubMed
description Depth estimation is a crucial component in many 3D vision applications. Monocular depth estimation is gaining increasing interest due to flexible use and extremely low system requirements, but inherently ill-posed and ambiguous characteristics still cause unsatisfactory estimation results. This paper proposes a new deep convolutional neural network for monocular depth estimation. The network applies joint attention feature distillation and wavelet-based loss function to recover the depth information of a scene. Two improvements were achieved, compared with previous methods. First, we combined feature distillation and joint attention mechanisms to boost feature modulation discrimination. The network extracts hierarchical features using a progressive feature distillation and refinement strategy and aggregates features using a joint attention operation. Second, we adopted a wavelet-based loss function for network training, which improves loss function effectiveness by obtaining more structural details. The experimental results on challenging indoor and outdoor benchmark datasets verified the proposed method’s superiority compared with current state-of-the-art methods.
format Online
Article
Text
id pubmed-7794707
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-77947072021-01-10 Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function Liu, Peng Zhang, Zonghua Meng, Zhaozong Gao, Nan Sensors (Basel) Article Depth estimation is a crucial component in many 3D vision applications. Monocular depth estimation is gaining increasing interest due to flexible use and extremely low system requirements, but inherently ill-posed and ambiguous characteristics still cause unsatisfactory estimation results. This paper proposes a new deep convolutional neural network for monocular depth estimation. The network applies joint attention feature distillation and wavelet-based loss function to recover the depth information of a scene. Two improvements were achieved, compared with previous methods. First, we combined feature distillation and joint attention mechanisms to boost feature modulation discrimination. The network extracts hierarchical features using a progressive feature distillation and refinement strategy and aggregates features using a joint attention operation. Second, we adopted a wavelet-based loss function for network training, which improves loss function effectiveness by obtaining more structural details. The experimental results on challenging indoor and outdoor benchmark datasets verified the proposed method’s superiority compared with current state-of-the-art methods. MDPI 2020-12-24 /pmc/articles/PMC7794707/ /pubmed/33374278 http://dx.doi.org/10.3390/s21010054 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Liu, Peng
Zhang, Zonghua
Meng, Zhaozong
Gao, Nan
Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function
title Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function
title_full Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function
title_fullStr Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function
title_full_unstemmed Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function
title_short Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function
title_sort monocular depth estimation with joint attention feature distillation and wavelet-based loss function
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7794707/
https://www.ncbi.nlm.nih.gov/pubmed/33374278
http://dx.doi.org/10.3390/s21010054
work_keys_str_mv AT liupeng monoculardepthestimationwithjointattentionfeaturedistillationandwaveletbasedlossfunction
AT zhangzonghua monoculardepthestimationwithjointattentionfeaturedistillationandwaveletbasedlossfunction
AT mengzhaozong monoculardepthestimationwithjointattentionfeaturedistillationandwaveletbasedlossfunction
AT gaonan monoculardepthestimationwithjointattentionfeaturedistillationandwaveletbasedlossfunction