Cargando…

YOLO object detection models can locate and classify broad groups of flower-visiting arthropods in images

Develoment of image recognition AI algorithms for flower-visiting arthropods has the potential to revolutionize the way we monitor pollinators. Ecologists need light-weight models that can be deployed in a field setting and can classify with high accuracy. We tested the performance of three deep lea...

Descripción completa

Detalles Bibliográficos
Autores principales: Stark, Thomas, Ştefan, Valentin, Wurm, Michael, Spanier, Robin, Taubenböck, Hannes, Knight, Tiffany M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10541899/
https://www.ncbi.nlm.nih.gov/pubmed/37773202
http://dx.doi.org/10.1038/s41598-023-43482-3
_version_ 1785113997590134784
author Stark, Thomas
Ştefan, Valentin
Wurm, Michael
Spanier, Robin
Taubenböck, Hannes
Knight, Tiffany M.
author_facet Stark, Thomas
Ştefan, Valentin
Wurm, Michael
Spanier, Robin
Taubenböck, Hannes
Knight, Tiffany M.
author_sort Stark, Thomas
collection PubMed
description Develoment of image recognition AI algorithms for flower-visiting arthropods has the potential to revolutionize the way we monitor pollinators. Ecologists need light-weight models that can be deployed in a field setting and can classify with high accuracy. We tested the performance of three deep learning light-weight models, YOLOv5nano, YOLOv5small, and YOLOv7tiny, at object recognition and classification in real time on eight groups of flower-visiting arthropods using open-source image data. These eight groups contained four orders of insects that are known to perform the majority of pollination services in Europe (Hymenoptera, Diptera, Coleoptera, Lepidoptera) as well as other arthropod groups that can be seen on flowers but are not typically considered pollinators (e.g., spiders-Araneae). All three models had high accuracy, ranging from 93 to 97%. Intersection over union (IoU) depended on the relative area of the bounding box, and the models performed best when a single arthropod comprised a large portion of the image and worst when multiple small arthropods were together in a single image. The model could accurately distinguish flies in the family Syrphidae from the Hymenoptera that they are known to mimic. These results reveal the capability of existing YOLO models to contribute to pollination monitoring.
format Online
Article
Text
id pubmed-10541899
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-105418992023-10-02 YOLO object detection models can locate and classify broad groups of flower-visiting arthropods in images Stark, Thomas Ştefan, Valentin Wurm, Michael Spanier, Robin Taubenböck, Hannes Knight, Tiffany M. Sci Rep Article Develoment of image recognition AI algorithms for flower-visiting arthropods has the potential to revolutionize the way we monitor pollinators. Ecologists need light-weight models that can be deployed in a field setting and can classify with high accuracy. We tested the performance of three deep learning light-weight models, YOLOv5nano, YOLOv5small, and YOLOv7tiny, at object recognition and classification in real time on eight groups of flower-visiting arthropods using open-source image data. These eight groups contained four orders of insects that are known to perform the majority of pollination services in Europe (Hymenoptera, Diptera, Coleoptera, Lepidoptera) as well as other arthropod groups that can be seen on flowers but are not typically considered pollinators (e.g., spiders-Araneae). All three models had high accuracy, ranging from 93 to 97%. Intersection over union (IoU) depended on the relative area of the bounding box, and the models performed best when a single arthropod comprised a large portion of the image and worst when multiple small arthropods were together in a single image. The model could accurately distinguish flies in the family Syrphidae from the Hymenoptera that they are known to mimic. These results reveal the capability of existing YOLO models to contribute to pollination monitoring. Nature Publishing Group UK 2023-09-29 /pmc/articles/PMC10541899/ /pubmed/37773202 http://dx.doi.org/10.1038/s41598-023-43482-3 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Stark, Thomas
Ştefan, Valentin
Wurm, Michael
Spanier, Robin
Taubenböck, Hannes
Knight, Tiffany M.
YOLO object detection models can locate and classify broad groups of flower-visiting arthropods in images
title YOLO object detection models can locate and classify broad groups of flower-visiting arthropods in images
title_full YOLO object detection models can locate and classify broad groups of flower-visiting arthropods in images
title_fullStr YOLO object detection models can locate and classify broad groups of flower-visiting arthropods in images
title_full_unstemmed YOLO object detection models can locate and classify broad groups of flower-visiting arthropods in images
title_short YOLO object detection models can locate and classify broad groups of flower-visiting arthropods in images
title_sort yolo object detection models can locate and classify broad groups of flower-visiting arthropods in images
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10541899/
https://www.ncbi.nlm.nih.gov/pubmed/37773202
http://dx.doi.org/10.1038/s41598-023-43482-3
work_keys_str_mv AT starkthomas yoloobjectdetectionmodelscanlocateandclassifybroadgroupsofflowervisitingarthropodsinimages
AT stefanvalentin yoloobjectdetectionmodelscanlocateandclassifybroadgroupsofflowervisitingarthropodsinimages
AT wurmmichael yoloobjectdetectionmodelscanlocateandclassifybroadgroupsofflowervisitingarthropodsinimages
AT spanierrobin yoloobjectdetectionmodelscanlocateandclassifybroadgroupsofflowervisitingarthropodsinimages
AT taubenbockhannes yoloobjectdetectionmodelscanlocateandclassifybroadgroupsofflowervisitingarthropodsinimages
AT knighttiffanym yoloobjectdetectionmodelscanlocateandclassifybroadgroupsofflowervisitingarthropodsinimages