Cargando…
Recognition and Matching of Clustered Mature Litchi Fruits Using Binocular Charge-Coupled Device (CCD) Color Cameras
Recognition and matching of litchi fruits are critical steps for litchi harvesting robots to successfully grasp litchi. However, due to the randomness of litchi growth, such as clustered growth with uncertain number of fruits and random occlusion by leaves, branches and other fruits, the recognition...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2017
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5713152/ https://www.ncbi.nlm.nih.gov/pubmed/29112177 http://dx.doi.org/10.3390/s17112564 |
_version_ | 1783283359158370304 |
---|---|
author | Wang, Chenglin Tang, Yunchao Zou, Xiangjun Luo, Lufeng Chen, Xiong |
author_facet | Wang, Chenglin Tang, Yunchao Zou, Xiangjun Luo, Lufeng Chen, Xiong |
author_sort | Wang, Chenglin |
collection | PubMed |
description | Recognition and matching of litchi fruits are critical steps for litchi harvesting robots to successfully grasp litchi. However, due to the randomness of litchi growth, such as clustered growth with uncertain number of fruits and random occlusion by leaves, branches and other fruits, the recognition and matching of the fruit become a challenge. Therefore, this study firstly defined mature litchi fruit as three clustered categories. Then an approach for recognition and matching of clustered mature litchi fruit was developed based on litchi color images acquired by binocular charge-coupled device (CCD) color cameras. The approach mainly included three steps: (1) calibration of binocular color cameras and litchi image acquisition; (2) segmentation of litchi fruits using four kinds of supervised classifiers, and recognition of the pre-defined categories of clustered litchi fruit using a pixel threshold method; and (3) matching the recognized clustered fruit using a geometric center-based matching method. The experimental results showed that the proposed recognition method could be robust against the influences of varying illumination and occlusion conditions, and precisely recognize clustered litchi fruit. In the tested 432 clustered litchi fruits, the highest and lowest average recognition rates were 94.17% and 92.00% under sunny back-lighting and partial occlusion, and sunny front-lighting and non-occlusion conditions, respectively. From 50 pairs of tested images, the highest and lowest matching success rates were 97.37% and 91.96% under sunny back-lighting and non-occlusion, and sunny front-lighting and partial occlusion conditions, respectively. |
format | Online Article Text |
id | pubmed-5713152 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2017 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-57131522017-12-07 Recognition and Matching of Clustered Mature Litchi Fruits Using Binocular Charge-Coupled Device (CCD) Color Cameras Wang, Chenglin Tang, Yunchao Zou, Xiangjun Luo, Lufeng Chen, Xiong Sensors (Basel) Article Recognition and matching of litchi fruits are critical steps for litchi harvesting robots to successfully grasp litchi. However, due to the randomness of litchi growth, such as clustered growth with uncertain number of fruits and random occlusion by leaves, branches and other fruits, the recognition and matching of the fruit become a challenge. Therefore, this study firstly defined mature litchi fruit as three clustered categories. Then an approach for recognition and matching of clustered mature litchi fruit was developed based on litchi color images acquired by binocular charge-coupled device (CCD) color cameras. The approach mainly included three steps: (1) calibration of binocular color cameras and litchi image acquisition; (2) segmentation of litchi fruits using four kinds of supervised classifiers, and recognition of the pre-defined categories of clustered litchi fruit using a pixel threshold method; and (3) matching the recognized clustered fruit using a geometric center-based matching method. The experimental results showed that the proposed recognition method could be robust against the influences of varying illumination and occlusion conditions, and precisely recognize clustered litchi fruit. In the tested 432 clustered litchi fruits, the highest and lowest average recognition rates were 94.17% and 92.00% under sunny back-lighting and partial occlusion, and sunny front-lighting and non-occlusion conditions, respectively. From 50 pairs of tested images, the highest and lowest matching success rates were 97.37% and 91.96% under sunny back-lighting and non-occlusion, and sunny front-lighting and partial occlusion conditions, respectively. MDPI 2017-11-07 /pmc/articles/PMC5713152/ /pubmed/29112177 http://dx.doi.org/10.3390/s17112564 Text en © 2017 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Wang, Chenglin Tang, Yunchao Zou, Xiangjun Luo, Lufeng Chen, Xiong Recognition and Matching of Clustered Mature Litchi Fruits Using Binocular Charge-Coupled Device (CCD) Color Cameras |
title | Recognition and Matching of Clustered Mature Litchi Fruits Using Binocular Charge-Coupled Device (CCD) Color Cameras |
title_full | Recognition and Matching of Clustered Mature Litchi Fruits Using Binocular Charge-Coupled Device (CCD) Color Cameras |
title_fullStr | Recognition and Matching of Clustered Mature Litchi Fruits Using Binocular Charge-Coupled Device (CCD) Color Cameras |
title_full_unstemmed | Recognition and Matching of Clustered Mature Litchi Fruits Using Binocular Charge-Coupled Device (CCD) Color Cameras |
title_short | Recognition and Matching of Clustered Mature Litchi Fruits Using Binocular Charge-Coupled Device (CCD) Color Cameras |
title_sort | recognition and matching of clustered mature litchi fruits using binocular charge-coupled device (ccd) color cameras |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5713152/ https://www.ncbi.nlm.nih.gov/pubmed/29112177 http://dx.doi.org/10.3390/s17112564 |
work_keys_str_mv | AT wangchenglin recognitionandmatchingofclusteredmaturelitchifruitsusingbinocularchargecoupleddeviceccdcolorcameras AT tangyunchao recognitionandmatchingofclusteredmaturelitchifruitsusingbinocularchargecoupleddeviceccdcolorcameras AT zouxiangjun recognitionandmatchingofclusteredmaturelitchifruitsusingbinocularchargecoupleddeviceccdcolorcameras AT luolufeng recognitionandmatchingofclusteredmaturelitchifruitsusingbinocularchargecoupleddeviceccdcolorcameras AT chenxiong recognitionandmatchingofclusteredmaturelitchifruitsusingbinocularchargecoupleddeviceccdcolorcameras |