Cargando…

Object Detection of Flexible Objects with Arbitrary Orientation Based on Rotation-Adaptive YOLOv5 †

It is challenging to accurately detect flexible objects with arbitrary orientation from monitoring images in power grid maintenance and inspection sites. This is because these images exhibit a significant imbalance between the foreground and background, which can lead to low detection accuracy when...

Descripción completa

Detalles Bibliográficos
Autores principales: Wu, Jiajun, Su, Lumei, Lin, Zhiwei, Chen, Yuhan, Ji, Jiaming, Li, Tianyou
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10223194/
https://www.ncbi.nlm.nih.gov/pubmed/37430839
http://dx.doi.org/10.3390/s23104925
_version_ 1785049883221164032
author Wu, Jiajun
Su, Lumei
Lin, Zhiwei
Chen, Yuhan
Ji, Jiaming
Li, Tianyou
author_facet Wu, Jiajun
Su, Lumei
Lin, Zhiwei
Chen, Yuhan
Ji, Jiaming
Li, Tianyou
author_sort Wu, Jiajun
collection PubMed
description It is challenging to accurately detect flexible objects with arbitrary orientation from monitoring images in power grid maintenance and inspection sites. This is because these images exhibit a significant imbalance between the foreground and background, which can lead to low detection accuracy when using a horizontal bounding box (HBB) as the detector in general object detection algorithms. Existing multi-oriented detection algorithms that use irregular polygons as the detector can improve accuracy to some extent, but their accuracy is limited due to boundary problems during the training process. This paper proposes a rotation-adaptive YOLOv5 (R_YOLOv5) with a rotated bounding box (RBB) to detect flexible objects with arbitrary orientation, effectively addressing the above issues and achieving high accuracy. Firstly, a long-side representation method is used to add the degree of freedom (DOF) for bounding boxes, enabling accurate detection of flexible objects with large spans, deformable shapes, and small foreground-to-background ratios. Furthermore, the further boundary problem induced by the proposed bounding box strategy is overcome by using classification discretization and symmetric function mapping methods. Finally, the loss function is optimized to ensure training convergence for the new bounding box. To meet various practical requirements, we propose four models with different scales based on YOLOv5, namely R_YOLOv5s, R_YOLOv5m, R_YOLOv5l, and R_YOLOv5x. Experimental results demonstrate that these four models achieve mean average precision (mAP) values of 0.712, 0.731, 0.736, and 0.745 on the DOTA-v1.5 dataset and 0.579, 0.629, 0.689, and 0.713 on our self-built FO dataset, exhibiting higher recognition accuracy and a stronger generalization ability. Among them, R_YOLOv5x achieves a mAP that is about 6.84% higher than ReDet on the DOTAv-1.5 dataset and at least 2% higher than the original YOLOv5 model on the FO dataset.
format Online
Article
Text
id pubmed-10223194
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-102231942023-05-28 Object Detection of Flexible Objects with Arbitrary Orientation Based on Rotation-Adaptive YOLOv5 † Wu, Jiajun Su, Lumei Lin, Zhiwei Chen, Yuhan Ji, Jiaming Li, Tianyou Sensors (Basel) Article It is challenging to accurately detect flexible objects with arbitrary orientation from monitoring images in power grid maintenance and inspection sites. This is because these images exhibit a significant imbalance between the foreground and background, which can lead to low detection accuracy when using a horizontal bounding box (HBB) as the detector in general object detection algorithms. Existing multi-oriented detection algorithms that use irregular polygons as the detector can improve accuracy to some extent, but their accuracy is limited due to boundary problems during the training process. This paper proposes a rotation-adaptive YOLOv5 (R_YOLOv5) with a rotated bounding box (RBB) to detect flexible objects with arbitrary orientation, effectively addressing the above issues and achieving high accuracy. Firstly, a long-side representation method is used to add the degree of freedom (DOF) for bounding boxes, enabling accurate detection of flexible objects with large spans, deformable shapes, and small foreground-to-background ratios. Furthermore, the further boundary problem induced by the proposed bounding box strategy is overcome by using classification discretization and symmetric function mapping methods. Finally, the loss function is optimized to ensure training convergence for the new bounding box. To meet various practical requirements, we propose four models with different scales based on YOLOv5, namely R_YOLOv5s, R_YOLOv5m, R_YOLOv5l, and R_YOLOv5x. Experimental results demonstrate that these four models achieve mean average precision (mAP) values of 0.712, 0.731, 0.736, and 0.745 on the DOTA-v1.5 dataset and 0.579, 0.629, 0.689, and 0.713 on our self-built FO dataset, exhibiting higher recognition accuracy and a stronger generalization ability. Among them, R_YOLOv5x achieves a mAP that is about 6.84% higher than ReDet on the DOTAv-1.5 dataset and at least 2% higher than the original YOLOv5 model on the FO dataset. MDPI 2023-05-20 /pmc/articles/PMC10223194/ /pubmed/37430839 http://dx.doi.org/10.3390/s23104925 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wu, Jiajun
Su, Lumei
Lin, Zhiwei
Chen, Yuhan
Ji, Jiaming
Li, Tianyou
Object Detection of Flexible Objects with Arbitrary Orientation Based on Rotation-Adaptive YOLOv5 †
title Object Detection of Flexible Objects with Arbitrary Orientation Based on Rotation-Adaptive YOLOv5 †
title_full Object Detection of Flexible Objects with Arbitrary Orientation Based on Rotation-Adaptive YOLOv5 †
title_fullStr Object Detection of Flexible Objects with Arbitrary Orientation Based on Rotation-Adaptive YOLOv5 †
title_full_unstemmed Object Detection of Flexible Objects with Arbitrary Orientation Based on Rotation-Adaptive YOLOv5 †
title_short Object Detection of Flexible Objects with Arbitrary Orientation Based on Rotation-Adaptive YOLOv5 †
title_sort object detection of flexible objects with arbitrary orientation based on rotation-adaptive yolov5 †
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10223194/
https://www.ncbi.nlm.nih.gov/pubmed/37430839
http://dx.doi.org/10.3390/s23104925
work_keys_str_mv AT wujiajun objectdetectionofflexibleobjectswitharbitraryorientationbasedonrotationadaptiveyolov5
AT sulumei objectdetectionofflexibleobjectswitharbitraryorientationbasedonrotationadaptiveyolov5
AT linzhiwei objectdetectionofflexibleobjectswitharbitraryorientationbasedonrotationadaptiveyolov5
AT chenyuhan objectdetectionofflexibleobjectswitharbitraryorientationbasedonrotationadaptiveyolov5
AT jijiaming objectdetectionofflexibleobjectswitharbitraryorientationbasedonrotationadaptiveyolov5
AT litianyou objectdetectionofflexibleobjectswitharbitraryorientationbasedonrotationadaptiveyolov5