Cargando…
Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism
INTRODUCTION: Semantic segmentation is a crucial visual representation learning task for autonomous driving systems, as it enables the perception of surrounding objects and road conditions to ensure safe and efficient navigation. METHODS: In this paper, we present a novel semantic segmentation appro...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10620498/ https://www.ncbi.nlm.nih.gov/pubmed/37928734 http://dx.doi.org/10.3389/fnins.2023.1291674 |
_version_ | 1785130219315658752 |
---|---|
author | Liu, Danping Zhang, Dong Wang, Lei Wang, Jun |
author_facet | Liu, Danping Zhang, Dong Wang, Lei Wang, Jun |
author_sort | Liu, Danping |
collection | PubMed |
description | INTRODUCTION: Semantic segmentation is a crucial visual representation learning task for autonomous driving systems, as it enables the perception of surrounding objects and road conditions to ensure safe and efficient navigation. METHODS: In this paper, we present a novel semantic segmentation approach for autonomous driving scenes using a Multi-Scale Adaptive Mechanism (MSAAM). The proposed method addresses the challenges associated with complex driving environments, including large-scale variations, occlusions, and diverse object appearances. Our MSAAM integrates multiple scale features and adaptively selects the most relevant features for precise segmentation. We introduce a novel attention module that incorporates spatial, channel-wise and scale-wise attention mechanisms to effectively enhance the discriminative power of features. RESULTS: The experimental results of the model on key objectives in the Cityscapes dataset are: ClassAvg:81.13, mIoU:71.46. The experimental results on comprehensive evaluation metrics are: AUROC:98.79, AP:68.46, FPR95:5.72. The experimental results in terms of computational cost are: GFLOPs:2117.01, Infer. Time (ms):61.06. All experimental results data are superior to the comparative method model. DISCUSSION: The proposed method achieves superior performance compared to state-of-the-art techniques on several benchmark datasets demonstrating its efficacy in addressing the challenges of autonomous driving scene understanding. |
format | Online Article Text |
id | pubmed-10620498 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-106204982023-11-03 Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism Liu, Danping Zhang, Dong Wang, Lei Wang, Jun Front Neurosci Neuroscience INTRODUCTION: Semantic segmentation is a crucial visual representation learning task for autonomous driving systems, as it enables the perception of surrounding objects and road conditions to ensure safe and efficient navigation. METHODS: In this paper, we present a novel semantic segmentation approach for autonomous driving scenes using a Multi-Scale Adaptive Mechanism (MSAAM). The proposed method addresses the challenges associated with complex driving environments, including large-scale variations, occlusions, and diverse object appearances. Our MSAAM integrates multiple scale features and adaptively selects the most relevant features for precise segmentation. We introduce a novel attention module that incorporates spatial, channel-wise and scale-wise attention mechanisms to effectively enhance the discriminative power of features. RESULTS: The experimental results of the model on key objectives in the Cityscapes dataset are: ClassAvg:81.13, mIoU:71.46. The experimental results on comprehensive evaluation metrics are: AUROC:98.79, AP:68.46, FPR95:5.72. The experimental results in terms of computational cost are: GFLOPs:2117.01, Infer. Time (ms):61.06. All experimental results data are superior to the comparative method model. DISCUSSION: The proposed method achieves superior performance compared to state-of-the-art techniques on several benchmark datasets demonstrating its efficacy in addressing the challenges of autonomous driving scene understanding. Frontiers Media S.A. 2023-10-19 /pmc/articles/PMC10620498/ /pubmed/37928734 http://dx.doi.org/10.3389/fnins.2023.1291674 Text en Copyright © 2023 Liu, Zhang, Wang and Wang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Liu, Danping Zhang, Dong Wang, Lei Wang, Jun Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism |
title | Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism |
title_full | Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism |
title_fullStr | Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism |
title_full_unstemmed | Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism |
title_short | Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism |
title_sort | semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10620498/ https://www.ncbi.nlm.nih.gov/pubmed/37928734 http://dx.doi.org/10.3389/fnins.2023.1291674 |
work_keys_str_mv | AT liudanping semanticsegmentationofautonomousdrivingscenesbasedonmultiscaleadaptiveattentionmechanism AT zhangdong semanticsegmentationofautonomousdrivingscenesbasedonmultiscaleadaptiveattentionmechanism AT wanglei semanticsegmentationofautonomousdrivingscenesbasedonmultiscaleadaptiveattentionmechanism AT wangjun semanticsegmentationofautonomousdrivingscenesbasedonmultiscaleadaptiveattentionmechanism |