Cargando…
On-Tree Mango Fruit Size Estimation Using RGB-D Images
In-field mango fruit sizing is useful for estimation of fruit maturation and size distribution, informing the decision to harvest, harvest resourcing (e.g., tray insert sizes), and marketing. In-field machine vision imaging has been used for fruit count, but assessment of fruit size from images also...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2017
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5751737/ https://www.ncbi.nlm.nih.gov/pubmed/29182534 http://dx.doi.org/10.3390/s17122738 |
_version_ | 1783290010305298432 |
---|---|
author | Wang, Zhenglin Walsh, Kerry B. Verma, Brijesh |
author_facet | Wang, Zhenglin Walsh, Kerry B. Verma, Brijesh |
author_sort | Wang, Zhenglin |
collection | PubMed |
description | In-field mango fruit sizing is useful for estimation of fruit maturation and size distribution, informing the decision to harvest, harvest resourcing (e.g., tray insert sizes), and marketing. In-field machine vision imaging has been used for fruit count, but assessment of fruit size from images also requires estimation of camera-to-fruit distance. Low cost examples of three technologies for assessment of camera to fruit distance were assessed: a RGB-D (depth) camera, a stereo vision camera and a Time of Flight (ToF) laser rangefinder. The RGB-D camera was recommended on cost and performance, although it functioned poorly in direct sunlight. The RGB-D camera was calibrated, and depth information matched to the RGB image. To detect fruit, a cascade detection with histogram of oriented gradients (HOG) feature was used, then Otsu’s method, followed by color thresholding was applied in the CIE L*a*b* color space to remove background objects (leaves, branches etc.). A one-dimensional (1D) filter was developed to remove the fruit pedicles, and an ellipse fitting method employed to identify well-separated fruit. Finally, fruit lineal dimensions were calculated using the RGB-D depth information, fruit image size and the thin lens formula. A Root Mean Square Error (RMSE) = 4.9 and 4.3 mm was achieved for estimated fruit length and width, respectively, relative to manual measurement, for which repeated human measures were characterized by a standard deviation of 1.2 mm. In conclusion, the RGB-D method for rapid in-field mango fruit size estimation is practical in terms of cost and ease of use, but cannot be used in direct intense sunshine. We believe this work represents the first practical implementation of machine vision fruit sizing in field, with practicality gauged in terms of cost and simplicity of operation. |
format | Online Article Text |
id | pubmed-5751737 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2017 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-57517372018-01-10 On-Tree Mango Fruit Size Estimation Using RGB-D Images Wang, Zhenglin Walsh, Kerry B. Verma, Brijesh Sensors (Basel) Article In-field mango fruit sizing is useful for estimation of fruit maturation and size distribution, informing the decision to harvest, harvest resourcing (e.g., tray insert sizes), and marketing. In-field machine vision imaging has been used for fruit count, but assessment of fruit size from images also requires estimation of camera-to-fruit distance. Low cost examples of three technologies for assessment of camera to fruit distance were assessed: a RGB-D (depth) camera, a stereo vision camera and a Time of Flight (ToF) laser rangefinder. The RGB-D camera was recommended on cost and performance, although it functioned poorly in direct sunlight. The RGB-D camera was calibrated, and depth information matched to the RGB image. To detect fruit, a cascade detection with histogram of oriented gradients (HOG) feature was used, then Otsu’s method, followed by color thresholding was applied in the CIE L*a*b* color space to remove background objects (leaves, branches etc.). A one-dimensional (1D) filter was developed to remove the fruit pedicles, and an ellipse fitting method employed to identify well-separated fruit. Finally, fruit lineal dimensions were calculated using the RGB-D depth information, fruit image size and the thin lens formula. A Root Mean Square Error (RMSE) = 4.9 and 4.3 mm was achieved for estimated fruit length and width, respectively, relative to manual measurement, for which repeated human measures were characterized by a standard deviation of 1.2 mm. In conclusion, the RGB-D method for rapid in-field mango fruit size estimation is practical in terms of cost and ease of use, but cannot be used in direct intense sunshine. We believe this work represents the first practical implementation of machine vision fruit sizing in field, with practicality gauged in terms of cost and simplicity of operation. MDPI 2017-11-28 /pmc/articles/PMC5751737/ /pubmed/29182534 http://dx.doi.org/10.3390/s17122738 Text en © 2017 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Wang, Zhenglin Walsh, Kerry B. Verma, Brijesh On-Tree Mango Fruit Size Estimation Using RGB-D Images |
title | On-Tree Mango Fruit Size Estimation Using RGB-D Images |
title_full | On-Tree Mango Fruit Size Estimation Using RGB-D Images |
title_fullStr | On-Tree Mango Fruit Size Estimation Using RGB-D Images |
title_full_unstemmed | On-Tree Mango Fruit Size Estimation Using RGB-D Images |
title_short | On-Tree Mango Fruit Size Estimation Using RGB-D Images |
title_sort | on-tree mango fruit size estimation using rgb-d images |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5751737/ https://www.ncbi.nlm.nih.gov/pubmed/29182534 http://dx.doi.org/10.3390/s17122738 |
work_keys_str_mv | AT wangzhenglin ontreemangofruitsizeestimationusingrgbdimages AT walshkerryb ontreemangofruitsizeestimationusingrgbdimages AT vermabrijesh ontreemangofruitsizeestimationusingrgbdimages |