Cargando…

Foggy Lane Dataset Synthesized from Monocular Images for Lane Detection Algorithms

Accurate lane detection is an essential function of dynamic traffic perception. Though deep learning (DL) based methods have been widely applied to lane detection tasks, such models rarely achieve sufficient accuracy in low-light weather conditions. To improve the model accuracy in foggy conditions,...

Descripción completa

Detalles Bibliográficos
Autores principales: Nie, Xiangyu, Xu, Zhejun, Zhang, Wei, Dong, Xue, Liu, Ning, Chen, Yuanfeng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9317608/
https://www.ncbi.nlm.nih.gov/pubmed/35890889
http://dx.doi.org/10.3390/s22145210
_version_ 1784755098451181568
author Nie, Xiangyu
Xu, Zhejun
Zhang, Wei
Dong, Xue
Liu, Ning
Chen, Yuanfeng
author_facet Nie, Xiangyu
Xu, Zhejun
Zhang, Wei
Dong, Xue
Liu, Ning
Chen, Yuanfeng
author_sort Nie, Xiangyu
collection PubMed
description Accurate lane detection is an essential function of dynamic traffic perception. Though deep learning (DL) based methods have been widely applied to lane detection tasks, such models rarely achieve sufficient accuracy in low-light weather conditions. To improve the model accuracy in foggy conditions, a new approach was proposed based on monocular depth prediction and an atmospheric scattering model to generate fog artificially. We applied our method to the existing CULane dataset collected in clear weather and generated 107,451 labeled foggy lane images under three different fog densities. The original and generated datasets were then used to train state-of-the-art (SOTA) lane detection networks. The experiments demonstrate that the synthetic dataset can significantly increase the lane detection accuracy of DL-based models in both artificially generated foggy lane images and real foggy scenes. Specifically, the lane detection model performance (F1-measure) was increased from 11.09 to 70.41 under the heaviest foggy conditions. Additionally, this data augmentation method was further applied to another dataset, VIL-100, to test the adaptability of this approach. Similarly, it was found that even when the camera position or level of brightness was changed from one dataset to another, the foggy data augmentation approach is still valid to improve model performance under foggy conditions without degrading accuracy on other weather conditions. Finally, this approach also sheds light on practical applications for other complex scenes such as nighttime and rainy days.
format Online
Article
Text
id pubmed-9317608
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-93176082022-07-27 Foggy Lane Dataset Synthesized from Monocular Images for Lane Detection Algorithms Nie, Xiangyu Xu, Zhejun Zhang, Wei Dong, Xue Liu, Ning Chen, Yuanfeng Sensors (Basel) Article Accurate lane detection is an essential function of dynamic traffic perception. Though deep learning (DL) based methods have been widely applied to lane detection tasks, such models rarely achieve sufficient accuracy in low-light weather conditions. To improve the model accuracy in foggy conditions, a new approach was proposed based on monocular depth prediction and an atmospheric scattering model to generate fog artificially. We applied our method to the existing CULane dataset collected in clear weather and generated 107,451 labeled foggy lane images under three different fog densities. The original and generated datasets were then used to train state-of-the-art (SOTA) lane detection networks. The experiments demonstrate that the synthetic dataset can significantly increase the lane detection accuracy of DL-based models in both artificially generated foggy lane images and real foggy scenes. Specifically, the lane detection model performance (F1-measure) was increased from 11.09 to 70.41 under the heaviest foggy conditions. Additionally, this data augmentation method was further applied to another dataset, VIL-100, to test the adaptability of this approach. Similarly, it was found that even when the camera position or level of brightness was changed from one dataset to another, the foggy data augmentation approach is still valid to improve model performance under foggy conditions without degrading accuracy on other weather conditions. Finally, this approach also sheds light on practical applications for other complex scenes such as nighttime and rainy days. MDPI 2022-07-12 /pmc/articles/PMC9317608/ /pubmed/35890889 http://dx.doi.org/10.3390/s22145210 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Nie, Xiangyu
Xu, Zhejun
Zhang, Wei
Dong, Xue
Liu, Ning
Chen, Yuanfeng
Foggy Lane Dataset Synthesized from Monocular Images for Lane Detection Algorithms
title Foggy Lane Dataset Synthesized from Monocular Images for Lane Detection Algorithms
title_full Foggy Lane Dataset Synthesized from Monocular Images for Lane Detection Algorithms
title_fullStr Foggy Lane Dataset Synthesized from Monocular Images for Lane Detection Algorithms
title_full_unstemmed Foggy Lane Dataset Synthesized from Monocular Images for Lane Detection Algorithms
title_short Foggy Lane Dataset Synthesized from Monocular Images for Lane Detection Algorithms
title_sort foggy lane dataset synthesized from monocular images for lane detection algorithms
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9317608/
https://www.ncbi.nlm.nih.gov/pubmed/35890889
http://dx.doi.org/10.3390/s22145210
work_keys_str_mv AT niexiangyu foggylanedatasetsynthesizedfrommonocularimagesforlanedetectionalgorithms
AT xuzhejun foggylanedatasetsynthesizedfrommonocularimagesforlanedetectionalgorithms
AT zhangwei foggylanedatasetsynthesizedfrommonocularimagesforlanedetectionalgorithms
AT dongxue foggylanedatasetsynthesizedfrommonocularimagesforlanedetectionalgorithms
AT liuning foggylanedatasetsynthesizedfrommonocularimagesforlanedetectionalgorithms
AT chenyuanfeng foggylanedatasetsynthesizedfrommonocularimagesforlanedetectionalgorithms