Cargando…
Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects
Robust detection of deformable linear objects (DLOs) is a crucial challenge for the automation of handling and assembly of cables and hoses. The lack of training data is a limiting factor for deep-learning-based detection of DLOs. In this context, we propose an automatic image generation pipeline fo...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10058460/ https://www.ncbi.nlm.nih.gov/pubmed/36991728 http://dx.doi.org/10.3390/s23063013 |
_version_ | 1785016636718186496 |
---|---|
author | Dirr, Jonas Gebauer, Daniel Yao, Jiajun Daub, Rüdiger |
author_facet | Dirr, Jonas Gebauer, Daniel Yao, Jiajun Daub, Rüdiger |
author_sort | Dirr, Jonas |
collection | PubMed |
description | Robust detection of deformable linear objects (DLOs) is a crucial challenge for the automation of handling and assembly of cables and hoses. The lack of training data is a limiting factor for deep-learning-based detection of DLOs. In this context, we propose an automatic image generation pipeline for instance segmentation of DLOs. In this pipeline, a user can set boundary conditions to generate training data for industrial applications automatically. A comparison of different replication types of DLOs shows that modeling DLOs as rigid bodies with versatile deformations is most effective. Further, reference scenarios for the arrangement of DLOs are defined to generate scenes in a simulation automatically. This allows the pipelines to be quickly transferred to new applications. The validation of models trained with synthetic images and tested on real-world images shows the feasibility of the proposed data generation approach for segmentation of DLOs. Finally, we show that the pipeline yields results comparable to the state of the art but has advantages in reduced manual effort and transferability to new use cases. |
format | Online Article Text |
id | pubmed-10058460 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-100584602023-03-30 Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects Dirr, Jonas Gebauer, Daniel Yao, Jiajun Daub, Rüdiger Sensors (Basel) Article Robust detection of deformable linear objects (DLOs) is a crucial challenge for the automation of handling and assembly of cables and hoses. The lack of training data is a limiting factor for deep-learning-based detection of DLOs. In this context, we propose an automatic image generation pipeline for instance segmentation of DLOs. In this pipeline, a user can set boundary conditions to generate training data for industrial applications automatically. A comparison of different replication types of DLOs shows that modeling DLOs as rigid bodies with versatile deformations is most effective. Further, reference scenarios for the arrangement of DLOs are defined to generate scenes in a simulation automatically. This allows the pipelines to be quickly transferred to new applications. The validation of models trained with synthetic images and tested on real-world images shows the feasibility of the proposed data generation approach for segmentation of DLOs. Finally, we show that the pipeline yields results comparable to the state of the art but has advantages in reduced manual effort and transferability to new use cases. MDPI 2023-03-10 /pmc/articles/PMC10058460/ /pubmed/36991728 http://dx.doi.org/10.3390/s23063013 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Dirr, Jonas Gebauer, Daniel Yao, Jiajun Daub, Rüdiger Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects |
title | Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects |
title_full | Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects |
title_fullStr | Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects |
title_full_unstemmed | Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects |
title_short | Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects |
title_sort | automatic image generation pipeline for instance segmentation of deformable linear objects |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10058460/ https://www.ncbi.nlm.nih.gov/pubmed/36991728 http://dx.doi.org/10.3390/s23063013 |
work_keys_str_mv | AT dirrjonas automaticimagegenerationpipelineforinstancesegmentationofdeformablelinearobjects AT gebauerdaniel automaticimagegenerationpipelineforinstancesegmentationofdeformablelinearobjects AT yaojiajun automaticimagegenerationpipelineforinstancesegmentationofdeformablelinearobjects AT daubrudiger automaticimagegenerationpipelineforinstancesegmentationofdeformablelinearobjects |