Cargando…

A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture

The target recognition algorithm is one of the core technologies of Zanthoxylum pepper-picking robots. However, most existing detection algorithms cannot effectively detect Zanthoxylum fruit covered by branches, leaves and other fruits in natural scenes. To improve the work efficiency and adaptabili...

Descripción completa

Detalles Bibliográficos
Autores principales: Xu, Zhibo, Huang, Xiaopeng, Huang, Yuan, Sun, Haobo, Wan, Fangxin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8780191/
https://www.ncbi.nlm.nih.gov/pubmed/35062643
http://dx.doi.org/10.3390/s22020682
_version_ 1784637776359063552
author Xu, Zhibo
Huang, Xiaopeng
Huang, Yuan
Sun, Haobo
Wan, Fangxin
author_facet Xu, Zhibo
Huang, Xiaopeng
Huang, Yuan
Sun, Haobo
Wan, Fangxin
author_sort Xu, Zhibo
collection PubMed
description The target recognition algorithm is one of the core technologies of Zanthoxylum pepper-picking robots. However, most existing detection algorithms cannot effectively detect Zanthoxylum fruit covered by branches, leaves and other fruits in natural scenes. To improve the work efficiency and adaptability of the Zanthoxylum-picking robot in natural environments, and to recognize and detect fruits in complex environments under different lighting conditions, this paper presents a Zanthoxylum-picking-robot target detection method based on improved YOLOv5s. Firstly, an improved CBF module based on the CBH module in the backbone is raised to improve the detection accuracy. Secondly, the Specter module based on CBF is presented to replace the bottleneck CSP module, which improves the speed of detection with a lightweight structure. Finally, the Zanthoxylum fruit algorithm is checked by the improved YOLOv5 framework, and the differences in detection between YOLOv3, YOLOv4 and YOLOv5 are analyzed and evaluated. Through these improvements, the recall rate, recognition accuracy and mAP of the YOLOv5s are 4.19%, 28.7% and 14.8% higher than those of the original YOLOv5s, YOLOv3 and YOLOv4 models, respectively. Furthermore, the model is transferred to the computing platform of the robot with the cutting-edge NVIDIA Jetson TX2 device. Several experiments are implemented on the TX2, yielding an average time of inference of 0.072, with an average GPU load in 30 s of 20.11%. This method can provide technical support for pepper-picking robots to detect multiple pepper fruits in real time.
format Online
Article
Text
id pubmed-8780191
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-87801912022-01-22 A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture Xu, Zhibo Huang, Xiaopeng Huang, Yuan Sun, Haobo Wan, Fangxin Sensors (Basel) Article The target recognition algorithm is one of the core technologies of Zanthoxylum pepper-picking robots. However, most existing detection algorithms cannot effectively detect Zanthoxylum fruit covered by branches, leaves and other fruits in natural scenes. To improve the work efficiency and adaptability of the Zanthoxylum-picking robot in natural environments, and to recognize and detect fruits in complex environments under different lighting conditions, this paper presents a Zanthoxylum-picking-robot target detection method based on improved YOLOv5s. Firstly, an improved CBF module based on the CBH module in the backbone is raised to improve the detection accuracy. Secondly, the Specter module based on CBF is presented to replace the bottleneck CSP module, which improves the speed of detection with a lightweight structure. Finally, the Zanthoxylum fruit algorithm is checked by the improved YOLOv5 framework, and the differences in detection between YOLOv3, YOLOv4 and YOLOv5 are analyzed and evaluated. Through these improvements, the recall rate, recognition accuracy and mAP of the YOLOv5s are 4.19%, 28.7% and 14.8% higher than those of the original YOLOv5s, YOLOv3 and YOLOv4 models, respectively. Furthermore, the model is transferred to the computing platform of the robot with the cutting-edge NVIDIA Jetson TX2 device. Several experiments are implemented on the TX2, yielding an average time of inference of 0.072, with an average GPU load in 30 s of 20.11%. This method can provide technical support for pepper-picking robots to detect multiple pepper fruits in real time. MDPI 2022-01-17 /pmc/articles/PMC8780191/ /pubmed/35062643 http://dx.doi.org/10.3390/s22020682 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Xu, Zhibo
Huang, Xiaopeng
Huang, Yuan
Sun, Haobo
Wan, Fangxin
A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture
title A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture
title_full A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture
title_fullStr A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture
title_full_unstemmed A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture
title_short A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture
title_sort real-time zanthoxylum target detection method for an intelligent picking robot under a complex background, based on an improved yolov5s architecture
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8780191/
https://www.ncbi.nlm.nih.gov/pubmed/35062643
http://dx.doi.org/10.3390/s22020682
work_keys_str_mv AT xuzhibo arealtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture
AT huangxiaopeng arealtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture
AT huangyuan arealtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture
AT sunhaobo arealtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture
AT wanfangxin arealtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture
AT xuzhibo realtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture
AT huangxiaopeng realtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture
AT huangyuan realtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture
AT sunhaobo realtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture
AT wanfangxin realtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture