Cargando…
Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function
Depth estimation is a crucial component in many 3D vision applications. Monocular depth estimation is gaining increasing interest due to flexible use and extremely low system requirements, but inherently ill-posed and ambiguous characteristics still cause unsatisfactory estimation results. This pape...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7794707/ https://www.ncbi.nlm.nih.gov/pubmed/33374278 http://dx.doi.org/10.3390/s21010054 |
_version_ | 1783634272217726976 |
---|---|
author | Liu, Peng Zhang, Zonghua Meng, Zhaozong Gao, Nan |
author_facet | Liu, Peng Zhang, Zonghua Meng, Zhaozong Gao, Nan |
author_sort | Liu, Peng |
collection | PubMed |
description | Depth estimation is a crucial component in many 3D vision applications. Monocular depth estimation is gaining increasing interest due to flexible use and extremely low system requirements, but inherently ill-posed and ambiguous characteristics still cause unsatisfactory estimation results. This paper proposes a new deep convolutional neural network for monocular depth estimation. The network applies joint attention feature distillation and wavelet-based loss function to recover the depth information of a scene. Two improvements were achieved, compared with previous methods. First, we combined feature distillation and joint attention mechanisms to boost feature modulation discrimination. The network extracts hierarchical features using a progressive feature distillation and refinement strategy and aggregates features using a joint attention operation. Second, we adopted a wavelet-based loss function for network training, which improves loss function effectiveness by obtaining more structural details. The experimental results on challenging indoor and outdoor benchmark datasets verified the proposed method’s superiority compared with current state-of-the-art methods. |
format | Online Article Text |
id | pubmed-7794707 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-77947072021-01-10 Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function Liu, Peng Zhang, Zonghua Meng, Zhaozong Gao, Nan Sensors (Basel) Article Depth estimation is a crucial component in many 3D vision applications. Monocular depth estimation is gaining increasing interest due to flexible use and extremely low system requirements, but inherently ill-posed and ambiguous characteristics still cause unsatisfactory estimation results. This paper proposes a new deep convolutional neural network for monocular depth estimation. The network applies joint attention feature distillation and wavelet-based loss function to recover the depth information of a scene. Two improvements were achieved, compared with previous methods. First, we combined feature distillation and joint attention mechanisms to boost feature modulation discrimination. The network extracts hierarchical features using a progressive feature distillation and refinement strategy and aggregates features using a joint attention operation. Second, we adopted a wavelet-based loss function for network training, which improves loss function effectiveness by obtaining more structural details. The experimental results on challenging indoor and outdoor benchmark datasets verified the proposed method’s superiority compared with current state-of-the-art methods. MDPI 2020-12-24 /pmc/articles/PMC7794707/ /pubmed/33374278 http://dx.doi.org/10.3390/s21010054 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Liu, Peng Zhang, Zonghua Meng, Zhaozong Gao, Nan Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function |
title | Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function |
title_full | Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function |
title_fullStr | Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function |
title_full_unstemmed | Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function |
title_short | Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function |
title_sort | monocular depth estimation with joint attention feature distillation and wavelet-based loss function |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7794707/ https://www.ncbi.nlm.nih.gov/pubmed/33374278 http://dx.doi.org/10.3390/s21010054 |
work_keys_str_mv | AT liupeng monoculardepthestimationwithjointattentionfeaturedistillationandwaveletbasedlossfunction AT zhangzonghua monoculardepthestimationwithjointattentionfeaturedistillationandwaveletbasedlossfunction AT mengzhaozong monoculardepthestimationwithjointattentionfeaturedistillationandwaveletbasedlossfunction AT gaonan monoculardepthestimationwithjointattentionfeaturedistillationandwaveletbasedlossfunction |