Cargando…

Implementation of a Lightweight Semantic Segmentation Algorithm in Road Obstacle Detection

Due to deep learning’s accurate cognition of the street environment, the convolutional neural network has achieved dramatic development in the application of street scenes. Considering the needs of autonomous driving and assisted driving, in a general way, computer vision technology is used to find...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Bushi, Lv, Yongbo, Gu, Yang, Lv, Wanjun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7763539/
https://www.ncbi.nlm.nih.gov/pubmed/33322029
http://dx.doi.org/10.3390/s20247089
_version_ 1783628042208280576
author Liu, Bushi
Lv, Yongbo
Gu, Yang
Lv, Wanjun
author_facet Liu, Bushi
Lv, Yongbo
Gu, Yang
Lv, Wanjun
author_sort Liu, Bushi
collection PubMed
description Due to deep learning’s accurate cognition of the street environment, the convolutional neural network has achieved dramatic development in the application of street scenes. Considering the needs of autonomous driving and assisted driving, in a general way, computer vision technology is used to find obstacles to avoid collisions, which has made semantic segmentation a research priority in recent years. However, semantic segmentation has been constantly facing new challenges for quite a long time. Complex network depth information, large datasets, real-time requirements, etc., are typical problems that need to be solved urgently in the realization of autonomous driving technology. In order to address these problems, we propose an improved lightweight real-time semantic segmentation network, which is based on an efficient image cascading network (ICNet) architecture, using multi-scale branches and a cascaded feature fusion unit to extract rich multi-level features. In this paper, a spatial information network is designed to transmit more prior knowledge of spatial location and edge information. During the course of the training phase, we append an external loss function to enhance the learning process of the deep learning network system as well. This lightweight network can quickly perceive obstacles and detect roads in the drivable area from images to satisfy autonomous driving characteristics. The proposed model shows substantial performance on the Cityscapes dataset. With the premise of ensuring real-time performance, several sets of experimental comparisons illustrate that SP-ICNet enhances the accuracy of road obstacle detection and provides nearly ideal prediction outputs. Compared to the current popular semantic segmentation network, this study also demonstrates the effectiveness of our lightweight network for road obstacle detection in autonomous driving.
format Online
Article
Text
id pubmed-7763539
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-77635392020-12-27 Implementation of a Lightweight Semantic Segmentation Algorithm in Road Obstacle Detection Liu, Bushi Lv, Yongbo Gu, Yang Lv, Wanjun Sensors (Basel) Article Due to deep learning’s accurate cognition of the street environment, the convolutional neural network has achieved dramatic development in the application of street scenes. Considering the needs of autonomous driving and assisted driving, in a general way, computer vision technology is used to find obstacles to avoid collisions, which has made semantic segmentation a research priority in recent years. However, semantic segmentation has been constantly facing new challenges for quite a long time. Complex network depth information, large datasets, real-time requirements, etc., are typical problems that need to be solved urgently in the realization of autonomous driving technology. In order to address these problems, we propose an improved lightweight real-time semantic segmentation network, which is based on an efficient image cascading network (ICNet) architecture, using multi-scale branches and a cascaded feature fusion unit to extract rich multi-level features. In this paper, a spatial information network is designed to transmit more prior knowledge of spatial location and edge information. During the course of the training phase, we append an external loss function to enhance the learning process of the deep learning network system as well. This lightweight network can quickly perceive obstacles and detect roads in the drivable area from images to satisfy autonomous driving characteristics. The proposed model shows substantial performance on the Cityscapes dataset. With the premise of ensuring real-time performance, several sets of experimental comparisons illustrate that SP-ICNet enhances the accuracy of road obstacle detection and provides nearly ideal prediction outputs. Compared to the current popular semantic segmentation network, this study also demonstrates the effectiveness of our lightweight network for road obstacle detection in autonomous driving. MDPI 2020-12-10 /pmc/articles/PMC7763539/ /pubmed/33322029 http://dx.doi.org/10.3390/s20247089 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Liu, Bushi
Lv, Yongbo
Gu, Yang
Lv, Wanjun
Implementation of a Lightweight Semantic Segmentation Algorithm in Road Obstacle Detection
title Implementation of a Lightweight Semantic Segmentation Algorithm in Road Obstacle Detection
title_full Implementation of a Lightweight Semantic Segmentation Algorithm in Road Obstacle Detection
title_fullStr Implementation of a Lightweight Semantic Segmentation Algorithm in Road Obstacle Detection
title_full_unstemmed Implementation of a Lightweight Semantic Segmentation Algorithm in Road Obstacle Detection
title_short Implementation of a Lightweight Semantic Segmentation Algorithm in Road Obstacle Detection
title_sort implementation of a lightweight semantic segmentation algorithm in road obstacle detection
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7763539/
https://www.ncbi.nlm.nih.gov/pubmed/33322029
http://dx.doi.org/10.3390/s20247089
work_keys_str_mv AT liubushi implementationofalightweightsemanticsegmentationalgorithminroadobstacledetection
AT lvyongbo implementationofalightweightsemanticsegmentationalgorithminroadobstacledetection
AT guyang implementationofalightweightsemanticsegmentationalgorithminroadobstacledetection
AT lvwanjun implementationofalightweightsemanticsegmentationalgorithminroadobstacledetection