Cargando…
A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture
The target recognition algorithm is one of the core technologies of Zanthoxylum pepper-picking robots. However, most existing detection algorithms cannot effectively detect Zanthoxylum fruit covered by branches, leaves and other fruits in natural scenes. To improve the work efficiency and adaptabili...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8780191/ https://www.ncbi.nlm.nih.gov/pubmed/35062643 http://dx.doi.org/10.3390/s22020682 |
_version_ | 1784637776359063552 |
---|---|
author | Xu, Zhibo Huang, Xiaopeng Huang, Yuan Sun, Haobo Wan, Fangxin |
author_facet | Xu, Zhibo Huang, Xiaopeng Huang, Yuan Sun, Haobo Wan, Fangxin |
author_sort | Xu, Zhibo |
collection | PubMed |
description | The target recognition algorithm is one of the core technologies of Zanthoxylum pepper-picking robots. However, most existing detection algorithms cannot effectively detect Zanthoxylum fruit covered by branches, leaves and other fruits in natural scenes. To improve the work efficiency and adaptability of the Zanthoxylum-picking robot in natural environments, and to recognize and detect fruits in complex environments under different lighting conditions, this paper presents a Zanthoxylum-picking-robot target detection method based on improved YOLOv5s. Firstly, an improved CBF module based on the CBH module in the backbone is raised to improve the detection accuracy. Secondly, the Specter module based on CBF is presented to replace the bottleneck CSP module, which improves the speed of detection with a lightweight structure. Finally, the Zanthoxylum fruit algorithm is checked by the improved YOLOv5 framework, and the differences in detection between YOLOv3, YOLOv4 and YOLOv5 are analyzed and evaluated. Through these improvements, the recall rate, recognition accuracy and mAP of the YOLOv5s are 4.19%, 28.7% and 14.8% higher than those of the original YOLOv5s, YOLOv3 and YOLOv4 models, respectively. Furthermore, the model is transferred to the computing platform of the robot with the cutting-edge NVIDIA Jetson TX2 device. Several experiments are implemented on the TX2, yielding an average time of inference of 0.072, with an average GPU load in 30 s of 20.11%. This method can provide technical support for pepper-picking robots to detect multiple pepper fruits in real time. |
format | Online Article Text |
id | pubmed-8780191 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-87801912022-01-22 A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture Xu, Zhibo Huang, Xiaopeng Huang, Yuan Sun, Haobo Wan, Fangxin Sensors (Basel) Article The target recognition algorithm is one of the core technologies of Zanthoxylum pepper-picking robots. However, most existing detection algorithms cannot effectively detect Zanthoxylum fruit covered by branches, leaves and other fruits in natural scenes. To improve the work efficiency and adaptability of the Zanthoxylum-picking robot in natural environments, and to recognize and detect fruits in complex environments under different lighting conditions, this paper presents a Zanthoxylum-picking-robot target detection method based on improved YOLOv5s. Firstly, an improved CBF module based on the CBH module in the backbone is raised to improve the detection accuracy. Secondly, the Specter module based on CBF is presented to replace the bottleneck CSP module, which improves the speed of detection with a lightweight structure. Finally, the Zanthoxylum fruit algorithm is checked by the improved YOLOv5 framework, and the differences in detection between YOLOv3, YOLOv4 and YOLOv5 are analyzed and evaluated. Through these improvements, the recall rate, recognition accuracy and mAP of the YOLOv5s are 4.19%, 28.7% and 14.8% higher than those of the original YOLOv5s, YOLOv3 and YOLOv4 models, respectively. Furthermore, the model is transferred to the computing platform of the robot with the cutting-edge NVIDIA Jetson TX2 device. Several experiments are implemented on the TX2, yielding an average time of inference of 0.072, with an average GPU load in 30 s of 20.11%. This method can provide technical support for pepper-picking robots to detect multiple pepper fruits in real time. MDPI 2022-01-17 /pmc/articles/PMC8780191/ /pubmed/35062643 http://dx.doi.org/10.3390/s22020682 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Xu, Zhibo Huang, Xiaopeng Huang, Yuan Sun, Haobo Wan, Fangxin A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture |
title | A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture |
title_full | A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture |
title_fullStr | A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture |
title_full_unstemmed | A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture |
title_short | A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture |
title_sort | real-time zanthoxylum target detection method for an intelligent picking robot under a complex background, based on an improved yolov5s architecture |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8780191/ https://www.ncbi.nlm.nih.gov/pubmed/35062643 http://dx.doi.org/10.3390/s22020682 |
work_keys_str_mv | AT xuzhibo arealtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture AT huangxiaopeng arealtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture AT huangyuan arealtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture AT sunhaobo arealtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture AT wanfangxin arealtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture AT xuzhibo realtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture AT huangxiaopeng realtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture AT huangyuan realtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture AT sunhaobo realtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture AT wanfangxin realtimezanthoxylumtargetdetectionmethodforanintelligentpickingrobotunderacomplexbackgroundbasedonanimprovedyolov5sarchitecture |