Cargando…

eWaSR—An Embedded-Compute-Ready Maritime Obstacle Detection Network

Maritime obstacle detection is critical for safe navigation of autonomous surface vehicles (ASVs). While the accuracy of image-based detection methods has advanced substantially, their computational and memory requirements prohibit deployment on embedded devices. In this paper, we analyze the curren...

Descripción completa

Detalles Bibliográficos
Autores principales: Teršek, Matija, Žust, Lojze, Kristan, Matej
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10303570/
https://www.ncbi.nlm.nih.gov/pubmed/37420553
http://dx.doi.org/10.3390/s23125386
_version_ 1785065307951333376
author Teršek, Matija
Žust, Lojze
Kristan, Matej
author_facet Teršek, Matija
Žust, Lojze
Kristan, Matej
author_sort Teršek, Matija
collection PubMed
description Maritime obstacle detection is critical for safe navigation of autonomous surface vehicles (ASVs). While the accuracy of image-based detection methods has advanced substantially, their computational and memory requirements prohibit deployment on embedded devices. In this paper, we analyze the current best-performing maritime obstacle detection network, WaSR. Based on the analysis, we then propose replacements for the most computationally intensive stages and propose its embedded-compute-ready variant, eWaSR. In particular, the new design follows the most recent advancements of transformer-based lightweight networks. eWaSR achieves comparable detection results to state-of-the-art WaSR with only a [Formula: see text] F1 score performance drop and outperforms other state-of-the-art embedded-ready architectures by over [Formula: see text] in F1 score. On a standard GPU, eWaSR runs 10× faster than the original WaSR (115 FPS vs. 11 FPS). Tests on a real embedded sensor OAK-D show that, while WaSR cannot run due to memory restrictions, eWaSR runs comfortably at 5.5 FPS. This makes eWaSR the first practical embedded-compute-ready maritime obstacle detection network. The source code and trained eWaSR models are publicly available.
format Online
Article
Text
id pubmed-10303570
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-103035702023-06-29 eWaSR—An Embedded-Compute-Ready Maritime Obstacle Detection Network Teršek, Matija Žust, Lojze Kristan, Matej Sensors (Basel) Article Maritime obstacle detection is critical for safe navigation of autonomous surface vehicles (ASVs). While the accuracy of image-based detection methods has advanced substantially, their computational and memory requirements prohibit deployment on embedded devices. In this paper, we analyze the current best-performing maritime obstacle detection network, WaSR. Based on the analysis, we then propose replacements for the most computationally intensive stages and propose its embedded-compute-ready variant, eWaSR. In particular, the new design follows the most recent advancements of transformer-based lightweight networks. eWaSR achieves comparable detection results to state-of-the-art WaSR with only a [Formula: see text] F1 score performance drop and outperforms other state-of-the-art embedded-ready architectures by over [Formula: see text] in F1 score. On a standard GPU, eWaSR runs 10× faster than the original WaSR (115 FPS vs. 11 FPS). Tests on a real embedded sensor OAK-D show that, while WaSR cannot run due to memory restrictions, eWaSR runs comfortably at 5.5 FPS. This makes eWaSR the first practical embedded-compute-ready maritime obstacle detection network. The source code and trained eWaSR models are publicly available. MDPI 2023-06-07 /pmc/articles/PMC10303570/ /pubmed/37420553 http://dx.doi.org/10.3390/s23125386 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Teršek, Matija
Žust, Lojze
Kristan, Matej
eWaSR—An Embedded-Compute-Ready Maritime Obstacle Detection Network
title eWaSR—An Embedded-Compute-Ready Maritime Obstacle Detection Network
title_full eWaSR—An Embedded-Compute-Ready Maritime Obstacle Detection Network
title_fullStr eWaSR—An Embedded-Compute-Ready Maritime Obstacle Detection Network
title_full_unstemmed eWaSR—An Embedded-Compute-Ready Maritime Obstacle Detection Network
title_short eWaSR—An Embedded-Compute-Ready Maritime Obstacle Detection Network
title_sort ewasr—an embedded-compute-ready maritime obstacle detection network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10303570/
https://www.ncbi.nlm.nih.gov/pubmed/37420553
http://dx.doi.org/10.3390/s23125386
work_keys_str_mv AT tersekmatija ewasranembeddedcomputereadymaritimeobstacledetectionnetwork
AT zustlojze ewasranembeddedcomputereadymaritimeobstacledetectionnetwork
AT kristanmatej ewasranembeddedcomputereadymaritimeobstacledetectionnetwork