Cargando…

Lightweight and Energy-Aware Monocular Depth Estimation Models for IoT Embedded Devices: Challenges and Performances in Terrestrial and Underwater Scenarios †

The knowledge of environmental depth is essential in multiple robotics and computer vision tasks for both terrestrial and underwater scenarios. Moreover, the hardware on which this technology runs, generally IoT and embedded devices, are limited in terms of power consumption, and therefore, models w...

Descripción completa

Detalles Bibliográficos
Autores principales: Papa, Lorenzo, Proietti Mattia, Gabriele, Russo, Paolo, Amerini, Irene, Beraldi, Roberto
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9966799/
https://www.ncbi.nlm.nih.gov/pubmed/36850825
http://dx.doi.org/10.3390/s23042223
_version_ 1784897106573524992
author Papa, Lorenzo
Proietti Mattia, Gabriele
Russo, Paolo
Amerini, Irene
Beraldi, Roberto
author_facet Papa, Lorenzo
Proietti Mattia, Gabriele
Russo, Paolo
Amerini, Irene
Beraldi, Roberto
author_sort Papa, Lorenzo
collection PubMed
description The knowledge of environmental depth is essential in multiple robotics and computer vision tasks for both terrestrial and underwater scenarios. Moreover, the hardware on which this technology runs, generally IoT and embedded devices, are limited in terms of power consumption, and therefore, models with a low-energy footprint are required to be designed. Recent works aim at enabling depth perception using single RGB images on deep architectures, such as convolutional neural networks and vision transformers, which are generally unsuitable for real-time inferences on low-power embedded hardware. Moreover, such architectures are trained to estimate depth maps mainly on terrestrial scenarios due to the scarcity of underwater depth data. Purposely, we present two lightweight architectures based on optimized MobileNetV3 encoders and a specifically designed decoder to achieve fast inferences and accurate estimations over embedded devices, a feasibility study to predict depth maps over underwater scenarios, and an energy assessment to understand which is the effective energy consumption during the inference. Precisely, we propose the MobileNetV3 [Formula: see text] configuration to infer on the 32-bit ARM CPU and the MobileNetV3 [Formula: see text] for the 8-bit Edge TPU hardware. In underwater settings, the proposed design achieves comparable estimations with fast inference performances compared to state-of-the-art methods. Moreover, we statistically proved that the architecture of the models has an impact on the energy footprint in terms of Watts required by the device during the inference. Then, the proposed architectures would be considered to be a promising approach for real-time monocular depth estimation by offering the best trade-off between inference performances, estimation error and energy consumption, with the aim of improving the environment perception for underwater drones, lightweight robots and Internet of things.
format Online
Article
Text
id pubmed-9966799
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-99667992023-02-26 Lightweight and Energy-Aware Monocular Depth Estimation Models for IoT Embedded Devices: Challenges and Performances in Terrestrial and Underwater Scenarios † Papa, Lorenzo Proietti Mattia, Gabriele Russo, Paolo Amerini, Irene Beraldi, Roberto Sensors (Basel) Article The knowledge of environmental depth is essential in multiple robotics and computer vision tasks for both terrestrial and underwater scenarios. Moreover, the hardware on which this technology runs, generally IoT and embedded devices, are limited in terms of power consumption, and therefore, models with a low-energy footprint are required to be designed. Recent works aim at enabling depth perception using single RGB images on deep architectures, such as convolutional neural networks and vision transformers, which are generally unsuitable for real-time inferences on low-power embedded hardware. Moreover, such architectures are trained to estimate depth maps mainly on terrestrial scenarios due to the scarcity of underwater depth data. Purposely, we present two lightweight architectures based on optimized MobileNetV3 encoders and a specifically designed decoder to achieve fast inferences and accurate estimations over embedded devices, a feasibility study to predict depth maps over underwater scenarios, and an energy assessment to understand which is the effective energy consumption during the inference. Precisely, we propose the MobileNetV3 [Formula: see text] configuration to infer on the 32-bit ARM CPU and the MobileNetV3 [Formula: see text] for the 8-bit Edge TPU hardware. In underwater settings, the proposed design achieves comparable estimations with fast inference performances compared to state-of-the-art methods. Moreover, we statistically proved that the architecture of the models has an impact on the energy footprint in terms of Watts required by the device during the inference. Then, the proposed architectures would be considered to be a promising approach for real-time monocular depth estimation by offering the best trade-off between inference performances, estimation error and energy consumption, with the aim of improving the environment perception for underwater drones, lightweight robots and Internet of things. MDPI 2023-02-16 /pmc/articles/PMC9966799/ /pubmed/36850825 http://dx.doi.org/10.3390/s23042223 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Papa, Lorenzo
Proietti Mattia, Gabriele
Russo, Paolo
Amerini, Irene
Beraldi, Roberto
Lightweight and Energy-Aware Monocular Depth Estimation Models for IoT Embedded Devices: Challenges and Performances in Terrestrial and Underwater Scenarios †
title Lightweight and Energy-Aware Monocular Depth Estimation Models for IoT Embedded Devices: Challenges and Performances in Terrestrial and Underwater Scenarios †
title_full Lightweight and Energy-Aware Monocular Depth Estimation Models for IoT Embedded Devices: Challenges and Performances in Terrestrial and Underwater Scenarios †
title_fullStr Lightweight and Energy-Aware Monocular Depth Estimation Models for IoT Embedded Devices: Challenges and Performances in Terrestrial and Underwater Scenarios †
title_full_unstemmed Lightweight and Energy-Aware Monocular Depth Estimation Models for IoT Embedded Devices: Challenges and Performances in Terrestrial and Underwater Scenarios †
title_short Lightweight and Energy-Aware Monocular Depth Estimation Models for IoT Embedded Devices: Challenges and Performances in Terrestrial and Underwater Scenarios †
title_sort lightweight and energy-aware monocular depth estimation models for iot embedded devices: challenges and performances in terrestrial and underwater scenarios †
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9966799/
https://www.ncbi.nlm.nih.gov/pubmed/36850825
http://dx.doi.org/10.3390/s23042223
work_keys_str_mv AT papalorenzo lightweightandenergyawaremonoculardepthestimationmodelsforiotembeddeddeviceschallengesandperformancesinterrestrialandunderwaterscenarios
AT proiettimattiagabriele lightweightandenergyawaremonoculardepthestimationmodelsforiotembeddeddeviceschallengesandperformancesinterrestrialandunderwaterscenarios
AT russopaolo lightweightandenergyawaremonoculardepthestimationmodelsforiotembeddeddeviceschallengesandperformancesinterrestrialandunderwaterscenarios
AT ameriniirene lightweightandenergyawaremonoculardepthestimationmodelsforiotembeddeddeviceschallengesandperformancesinterrestrialandunderwaterscenarios
AT beraldiroberto lightweightandenergyawaremonoculardepthestimationmodelsforiotembeddeddeviceschallengesandperformancesinterrestrialandunderwaterscenarios