Cargando…

Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects

Robust detection of deformable linear objects (DLOs) is a crucial challenge for the automation of handling and assembly of cables and hoses. The lack of training data is a limiting factor for deep-learning-based detection of DLOs. In this context, we propose an automatic image generation pipeline fo...

Descripción completa

Detalles Bibliográficos
Autores principales: Dirr, Jonas, Gebauer, Daniel, Yao, Jiajun, Daub, Rüdiger
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10058460/
https://www.ncbi.nlm.nih.gov/pubmed/36991728
http://dx.doi.org/10.3390/s23063013
_version_ 1785016636718186496
author Dirr, Jonas
Gebauer, Daniel
Yao, Jiajun
Daub, Rüdiger
author_facet Dirr, Jonas
Gebauer, Daniel
Yao, Jiajun
Daub, Rüdiger
author_sort Dirr, Jonas
collection PubMed
description Robust detection of deformable linear objects (DLOs) is a crucial challenge for the automation of handling and assembly of cables and hoses. The lack of training data is a limiting factor for deep-learning-based detection of DLOs. In this context, we propose an automatic image generation pipeline for instance segmentation of DLOs. In this pipeline, a user can set boundary conditions to generate training data for industrial applications automatically. A comparison of different replication types of DLOs shows that modeling DLOs as rigid bodies with versatile deformations is most effective. Further, reference scenarios for the arrangement of DLOs are defined to generate scenes in a simulation automatically. This allows the pipelines to be quickly transferred to new applications. The validation of models trained with synthetic images and tested on real-world images shows the feasibility of the proposed data generation approach for segmentation of DLOs. Finally, we show that the pipeline yields results comparable to the state of the art but has advantages in reduced manual effort and transferability to new use cases.
format Online
Article
Text
id pubmed-10058460
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-100584602023-03-30 Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects Dirr, Jonas Gebauer, Daniel Yao, Jiajun Daub, Rüdiger Sensors (Basel) Article Robust detection of deformable linear objects (DLOs) is a crucial challenge for the automation of handling and assembly of cables and hoses. The lack of training data is a limiting factor for deep-learning-based detection of DLOs. In this context, we propose an automatic image generation pipeline for instance segmentation of DLOs. In this pipeline, a user can set boundary conditions to generate training data for industrial applications automatically. A comparison of different replication types of DLOs shows that modeling DLOs as rigid bodies with versatile deformations is most effective. Further, reference scenarios for the arrangement of DLOs are defined to generate scenes in a simulation automatically. This allows the pipelines to be quickly transferred to new applications. The validation of models trained with synthetic images and tested on real-world images shows the feasibility of the proposed data generation approach for segmentation of DLOs. Finally, we show that the pipeline yields results comparable to the state of the art but has advantages in reduced manual effort and transferability to new use cases. MDPI 2023-03-10 /pmc/articles/PMC10058460/ /pubmed/36991728 http://dx.doi.org/10.3390/s23063013 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Dirr, Jonas
Gebauer, Daniel
Yao, Jiajun
Daub, Rüdiger
Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects
title Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects
title_full Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects
title_fullStr Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects
title_full_unstemmed Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects
title_short Automatic Image Generation Pipeline for Instance Segmentation of Deformable Linear Objects
title_sort automatic image generation pipeline for instance segmentation of deformable linear objects
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10058460/
https://www.ncbi.nlm.nih.gov/pubmed/36991728
http://dx.doi.org/10.3390/s23063013
work_keys_str_mv AT dirrjonas automaticimagegenerationpipelineforinstancesegmentationofdeformablelinearobjects
AT gebauerdaniel automaticimagegenerationpipelineforinstancesegmentationofdeformablelinearobjects
AT yaojiajun automaticimagegenerationpipelineforinstancesegmentationofdeformablelinearobjects
AT daubrudiger automaticimagegenerationpipelineforinstancesegmentationofdeformablelinearobjects