Cargando…

Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques

The image of expressway asphalt pavement crack disease obtained by a three-dimensional line scan laser is easily affected by external factors such as uneven illumination distribution, environmental noise, occlusion shadow, and foreign bodies on the pavement. To locate and extract cracks accurately a...

Descripción completa

Detalles Bibliográficos
Autores principales: Yang, Zhen, Ni, Changshuang, Li, Lin, Luo, Wenting, Qin, Yong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9656577/
https://www.ncbi.nlm.nih.gov/pubmed/36366156
http://dx.doi.org/10.3390/s22218459
_version_ 1784829470565203968
author Yang, Zhen
Ni, Changshuang
Li, Lin
Luo, Wenting
Qin, Yong
author_facet Yang, Zhen
Ni, Changshuang
Li, Lin
Luo, Wenting
Qin, Yong
author_sort Yang, Zhen
collection PubMed
description The image of expressway asphalt pavement crack disease obtained by a three-dimensional line scan laser is easily affected by external factors such as uneven illumination distribution, environmental noise, occlusion shadow, and foreign bodies on the pavement. To locate and extract cracks accurately and efficiently, this article proposes a three-stage asphalt pavement crack location and segmentation method based on traditional digital image processing technology and deep learning methods. In the first stage of this method, the guided filtering and Retinex methods are used to preprocess the asphalt pavement crack image. The processed image removes redundant noise information and improves the brightness. At the information entropy level, it is 63% higher than the unpreprocessed image. In the second stage, the newly proposed YOLO-SAMT target detection model is used to locate the crack diseases in asphalt pavement. The model is 5.42 percentage points higher than the original YOLOv7 model on mAP@0.5, which enhances the recognition and location ability of crack diseases and reduces the calculation amount for the extraction of crack contour in the next stage. In the third stage, the improved k-means clustering algorithm is used to extract cracks. Compared with the traditional k-means clustering algorithm, this method improves the accuracy by 7.34 percentage points, the true rate by 6.57 percentage points, and the false positive rate by 18.32 percentage points to better extract the crack contour. To sum up, the method proposed in this article improves the quality of the pavement disease image, enhances the ability to identify and locate cracks, reduces the amount of calculation, improves the accuracy of crack contour extraction, and provides a new solution for highway crack inspection.
format Online
Article
Text
id pubmed-9656577
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-96565772022-11-15 Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques Yang, Zhen Ni, Changshuang Li, Lin Luo, Wenting Qin, Yong Sensors (Basel) Article The image of expressway asphalt pavement crack disease obtained by a three-dimensional line scan laser is easily affected by external factors such as uneven illumination distribution, environmental noise, occlusion shadow, and foreign bodies on the pavement. To locate and extract cracks accurately and efficiently, this article proposes a three-stage asphalt pavement crack location and segmentation method based on traditional digital image processing technology and deep learning methods. In the first stage of this method, the guided filtering and Retinex methods are used to preprocess the asphalt pavement crack image. The processed image removes redundant noise information and improves the brightness. At the information entropy level, it is 63% higher than the unpreprocessed image. In the second stage, the newly proposed YOLO-SAMT target detection model is used to locate the crack diseases in asphalt pavement. The model is 5.42 percentage points higher than the original YOLOv7 model on mAP@0.5, which enhances the recognition and location ability of crack diseases and reduces the calculation amount for the extraction of crack contour in the next stage. In the third stage, the improved k-means clustering algorithm is used to extract cracks. Compared with the traditional k-means clustering algorithm, this method improves the accuracy by 7.34 percentage points, the true rate by 6.57 percentage points, and the false positive rate by 18.32 percentage points to better extract the crack contour. To sum up, the method proposed in this article improves the quality of the pavement disease image, enhances the ability to identify and locate cracks, reduces the amount of calculation, improves the accuracy of crack contour extraction, and provides a new solution for highway crack inspection. MDPI 2022-11-03 /pmc/articles/PMC9656577/ /pubmed/36366156 http://dx.doi.org/10.3390/s22218459 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Yang, Zhen
Ni, Changshuang
Li, Lin
Luo, Wenting
Qin, Yong
Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques
title Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques
title_full Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques
title_fullStr Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques
title_full_unstemmed Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques
title_short Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques
title_sort three-stage pavement crack localization and segmentation algorithm based on digital image processing and deep learning techniques
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9656577/
https://www.ncbi.nlm.nih.gov/pubmed/36366156
http://dx.doi.org/10.3390/s22218459
work_keys_str_mv AT yangzhen threestagepavementcracklocalizationandsegmentationalgorithmbasedondigitalimageprocessinganddeeplearningtechniques
AT nichangshuang threestagepavementcracklocalizationandsegmentationalgorithmbasedondigitalimageprocessinganddeeplearningtechniques
AT lilin threestagepavementcracklocalizationandsegmentationalgorithmbasedondigitalimageprocessinganddeeplearningtechniques
AT luowenting threestagepavementcracklocalizationandsegmentationalgorithmbasedondigitalimageprocessinganddeeplearningtechniques
AT qinyong threestagepavementcracklocalizationandsegmentationalgorithmbasedondigitalimageprocessinganddeeplearningtechniques