Cargando…

Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications

Tracking droplets in microfluidics is a challenging task. The difficulty arises in choosing a tool to analyze general microfluidic videos to infer physical quantities. The state-of-the-art object detector algorithm You Only Look Once (YOLO) and the object tracking algorithm Simple Online and Realtim...

Descripción completa

Detalles Bibliográficos
Autores principales: Durve, Mihir, Orsini, Sibilla, Tiribocchi, Adriano, Montessori, Andrea, Tucny, Jean-Michel, Lauricella, Marco, Camposeo, Andrea, Pisignano, Dario, Succi, Sauro
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Berlin Heidelberg 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10167152/
https://www.ncbi.nlm.nih.gov/pubmed/37154834
http://dx.doi.org/10.1140/epje/s10189-023-00290-x
_version_ 1785038599490633728
author Durve, Mihir
Orsini, Sibilla
Tiribocchi, Adriano
Montessori, Andrea
Tucny, Jean-Michel
Lauricella, Marco
Camposeo, Andrea
Pisignano, Dario
Succi, Sauro
author_facet Durve, Mihir
Orsini, Sibilla
Tiribocchi, Adriano
Montessori, Andrea
Tucny, Jean-Michel
Lauricella, Marco
Camposeo, Andrea
Pisignano, Dario
Succi, Sauro
author_sort Durve, Mihir
collection PubMed
description Tracking droplets in microfluidics is a challenging task. The difficulty arises in choosing a tool to analyze general microfluidic videos to infer physical quantities. The state-of-the-art object detector algorithm You Only Look Once (YOLO) and the object tracking algorithm Simple Online and Realtime Tracking with a Deep Association Metric (DeepSORT) are customizable for droplet identification and tracking. The customization includes training YOLO and DeepSORT networks to identify and track the objects of interest. We trained several YOLOv5 and YOLOv7 models and the DeepSORT network for droplet identification and tracking from microfluidic experimental videos. We compare the performance of the droplet tracking applications with YOLOv5 and YOLOv7 in terms of training time and time to analyze a given video across various hardware configurations. Despite the latest YOLOv7 being 10% faster, the real-time tracking is only achieved by lighter YOLO models on RTX 3070 Ti GPU machine due to additional significant droplet tracking costs arising from the DeepSORT algorithm. This work is a benchmark study for the YOLOv5 and YOLOv7 networks with DeepSORT in terms of the training time and inference time for a custom dataset of microfluidic droplets.
format Online
Article
Text
id pubmed-10167152
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Springer Berlin Heidelberg
record_format MEDLINE/PubMed
spelling pubmed-101671522023-05-10 Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications Durve, Mihir Orsini, Sibilla Tiribocchi, Adriano Montessori, Andrea Tucny, Jean-Michel Lauricella, Marco Camposeo, Andrea Pisignano, Dario Succi, Sauro Eur Phys J E Soft Matter Regular Article - Flowing Matter Tracking droplets in microfluidics is a challenging task. The difficulty arises in choosing a tool to analyze general microfluidic videos to infer physical quantities. The state-of-the-art object detector algorithm You Only Look Once (YOLO) and the object tracking algorithm Simple Online and Realtime Tracking with a Deep Association Metric (DeepSORT) are customizable for droplet identification and tracking. The customization includes training YOLO and DeepSORT networks to identify and track the objects of interest. We trained several YOLOv5 and YOLOv7 models and the DeepSORT network for droplet identification and tracking from microfluidic experimental videos. We compare the performance of the droplet tracking applications with YOLOv5 and YOLOv7 in terms of training time and time to analyze a given video across various hardware configurations. Despite the latest YOLOv7 being 10% faster, the real-time tracking is only achieved by lighter YOLO models on RTX 3070 Ti GPU machine due to additional significant droplet tracking costs arising from the DeepSORT algorithm. This work is a benchmark study for the YOLOv5 and YOLOv7 networks with DeepSORT in terms of the training time and inference time for a custom dataset of microfluidic droplets. Springer Berlin Heidelberg 2023-05-08 2023 /pmc/articles/PMC10167152/ /pubmed/37154834 http://dx.doi.org/10.1140/epje/s10189-023-00290-x Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Regular Article - Flowing Matter
Durve, Mihir
Orsini, Sibilla
Tiribocchi, Adriano
Montessori, Andrea
Tucny, Jean-Michel
Lauricella, Marco
Camposeo, Andrea
Pisignano, Dario
Succi, Sauro
Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications
title Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications
title_full Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications
title_fullStr Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications
title_full_unstemmed Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications
title_short Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications
title_sort benchmarking yolov5 and yolov7 models with deepsort for droplet tracking applications
topic Regular Article - Flowing Matter
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10167152/
https://www.ncbi.nlm.nih.gov/pubmed/37154834
http://dx.doi.org/10.1140/epje/s10189-023-00290-x
work_keys_str_mv AT durvemihir benchmarkingyolov5andyolov7modelswithdeepsortfordroplettrackingapplications
AT orsinisibilla benchmarkingyolov5andyolov7modelswithdeepsortfordroplettrackingapplications
AT tiribocchiadriano benchmarkingyolov5andyolov7modelswithdeepsortfordroplettrackingapplications
AT montessoriandrea benchmarkingyolov5andyolov7modelswithdeepsortfordroplettrackingapplications
AT tucnyjeanmichel benchmarkingyolov5andyolov7modelswithdeepsortfordroplettrackingapplications
AT lauricellamarco benchmarkingyolov5andyolov7modelswithdeepsortfordroplettrackingapplications
AT camposeoandrea benchmarkingyolov5andyolov7modelswithdeepsortfordroplettrackingapplications
AT pisignanodario benchmarkingyolov5andyolov7modelswithdeepsortfordroplettrackingapplications
AT succisauro benchmarkingyolov5andyolov7modelswithdeepsortfordroplettrackingapplications