Cargando…

Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism

INTRODUCTION: Semantic segmentation is a crucial visual representation learning task for autonomous driving systems, as it enables the perception of surrounding objects and road conditions to ensure safe and efficient navigation. METHODS: In this paper, we present a novel semantic segmentation appro...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Danping, Zhang, Dong, Wang, Lei, Wang, Jun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10620498/
https://www.ncbi.nlm.nih.gov/pubmed/37928734
http://dx.doi.org/10.3389/fnins.2023.1291674
_version_ 1785130219315658752
author Liu, Danping
Zhang, Dong
Wang, Lei
Wang, Jun
author_facet Liu, Danping
Zhang, Dong
Wang, Lei
Wang, Jun
author_sort Liu, Danping
collection PubMed
description INTRODUCTION: Semantic segmentation is a crucial visual representation learning task for autonomous driving systems, as it enables the perception of surrounding objects and road conditions to ensure safe and efficient navigation. METHODS: In this paper, we present a novel semantic segmentation approach for autonomous driving scenes using a Multi-Scale Adaptive Mechanism (MSAAM). The proposed method addresses the challenges associated with complex driving environments, including large-scale variations, occlusions, and diverse object appearances. Our MSAAM integrates multiple scale features and adaptively selects the most relevant features for precise segmentation. We introduce a novel attention module that incorporates spatial, channel-wise and scale-wise attention mechanisms to effectively enhance the discriminative power of features. RESULTS: The experimental results of the model on key objectives in the Cityscapes dataset are: ClassAvg:81.13, mIoU:71.46. The experimental results on comprehensive evaluation metrics are: AUROC:98.79, AP:68.46, FPR95:5.72. The experimental results in terms of computational cost are: GFLOPs:2117.01, Infer. Time (ms):61.06. All experimental results data are superior to the comparative method model. DISCUSSION: The proposed method achieves superior performance compared to state-of-the-art techniques on several benchmark datasets demonstrating its efficacy in addressing the challenges of autonomous driving scene understanding.
format Online
Article
Text
id pubmed-10620498
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-106204982023-11-03 Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism Liu, Danping Zhang, Dong Wang, Lei Wang, Jun Front Neurosci Neuroscience INTRODUCTION: Semantic segmentation is a crucial visual representation learning task for autonomous driving systems, as it enables the perception of surrounding objects and road conditions to ensure safe and efficient navigation. METHODS: In this paper, we present a novel semantic segmentation approach for autonomous driving scenes using a Multi-Scale Adaptive Mechanism (MSAAM). The proposed method addresses the challenges associated with complex driving environments, including large-scale variations, occlusions, and diverse object appearances. Our MSAAM integrates multiple scale features and adaptively selects the most relevant features for precise segmentation. We introduce a novel attention module that incorporates spatial, channel-wise and scale-wise attention mechanisms to effectively enhance the discriminative power of features. RESULTS: The experimental results of the model on key objectives in the Cityscapes dataset are: ClassAvg:81.13, mIoU:71.46. The experimental results on comprehensive evaluation metrics are: AUROC:98.79, AP:68.46, FPR95:5.72. The experimental results in terms of computational cost are: GFLOPs:2117.01, Infer. Time (ms):61.06. All experimental results data are superior to the comparative method model. DISCUSSION: The proposed method achieves superior performance compared to state-of-the-art techniques on several benchmark datasets demonstrating its efficacy in addressing the challenges of autonomous driving scene understanding. Frontiers Media S.A. 2023-10-19 /pmc/articles/PMC10620498/ /pubmed/37928734 http://dx.doi.org/10.3389/fnins.2023.1291674 Text en Copyright © 2023 Liu, Zhang, Wang and Wang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Liu, Danping
Zhang, Dong
Wang, Lei
Wang, Jun
Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism
title Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism
title_full Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism
title_fullStr Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism
title_full_unstemmed Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism
title_short Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism
title_sort semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10620498/
https://www.ncbi.nlm.nih.gov/pubmed/37928734
http://dx.doi.org/10.3389/fnins.2023.1291674
work_keys_str_mv AT liudanping semanticsegmentationofautonomousdrivingscenesbasedonmultiscaleadaptiveattentionmechanism
AT zhangdong semanticsegmentationofautonomousdrivingscenesbasedonmultiscaleadaptiveattentionmechanism
AT wanglei semanticsegmentationofautonomousdrivingscenesbasedonmultiscaleadaptiveattentionmechanism
AT wangjun semanticsegmentationofautonomousdrivingscenesbasedonmultiscaleadaptiveattentionmechanism