A deep learning based fusion of RGB camera information and magnetic localization information for endoscopic capsule robots

A reliable, real time localization functionality is crutial for actively controlled capsule endoscopy robots, which are an emerging, minimally invasive diagnostic and therapeutic technology for the gastrointestinal (GI) tract. In this study, we extend the success of deep learning approaches from var...

Descripción completa

Detalles Bibliográficos
Autores principales: Turan, Mehmet, Shabbir, Jahanzaib, Araujo, Helder, Konukoglu, Ender, Sitti, Metin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Singapore 2017
Materias:
Regular Paper
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5727155/
https://www.ncbi.nlm.nih.gov/pubmed/29250590
http://dx.doi.org/10.1007/s41315-017-0039-1
_version_ 1783285817945358336
author Turan, Mehmet
Shabbir, Jahanzaib
Araujo, Helder
Konukoglu, Ender
Sitti, Metin
author_facet Turan, Mehmet
Shabbir, Jahanzaib
Araujo, Helder
Konukoglu, Ender
Sitti, Metin
author_sort Turan, Mehmet
collection PubMed
description A reliable, real time localization functionality is crutial for actively controlled capsule endoscopy robots, which are an emerging, minimally invasive diagnostic and therapeutic technology for the gastrointestinal (GI) tract. In this study, we extend the success of deep learning approaches from various research fields to the problem of sensor fusion for endoscopic capsule robots. We propose a multi-sensor fusion based localization approach which combines endoscopic camera information and magnetic sensor based localization information. The results performed on real pig stomach dataset show that our method achieves sub-millimeter precision for both translational and rotational movements.
format Online
Article
Text
id pubmed-5727155
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher Springer Singapore
record_format MEDLINE/PubMed
spelling pubmed-57271552017-12-14 A deep learning based fusion of RGB camera information and magnetic localization information for endoscopic capsule robots Turan, Mehmet Shabbir, Jahanzaib Araujo, Helder Konukoglu, Ender Sitti, Metin Int J Intell Robot Appl Regular Paper A reliable, real time localization functionality is crutial for actively controlled capsule endoscopy robots, which are an emerging, minimally invasive diagnostic and therapeutic technology for the gastrointestinal (GI) tract. In this study, we extend the success of deep learning approaches from various research fields to the problem of sensor fusion for endoscopic capsule robots. We propose a multi-sensor fusion based localization approach which combines endoscopic camera information and magnetic sensor based localization information. The results performed on real pig stomach dataset show that our method achieves sub-millimeter precision for both translational and rotational movements. Springer Singapore 2017-11-23 2017 /pmc/articles/PMC5727155/ /pubmed/29250590 http://dx.doi.org/10.1007/s41315-017-0039-1 Text en © The Author(s) 2017 Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
spellingShingle Regular Paper
Turan, Mehmet
Shabbir, Jahanzaib
Araujo, Helder
Konukoglu, Ender
Sitti, Metin
A deep learning based fusion of RGB camera information and magnetic localization information for endoscopic capsule robots
title A deep learning based fusion of RGB camera information and magnetic localization information for endoscopic capsule robots
title_full A deep learning based fusion of RGB camera information and magnetic localization information for endoscopic capsule robots
title_fullStr A deep learning based fusion of RGB camera information and magnetic localization information for endoscopic capsule robots
title_full_unstemmed A deep learning based fusion of RGB camera information and magnetic localization information for endoscopic capsule robots
title_short A deep learning based fusion of RGB camera information and magnetic localization information for endoscopic capsule robots
title_sort deep learning based fusion of rgb camera information and magnetic localization information for endoscopic capsule robots
topic Regular Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5727155/
https://www.ncbi.nlm.nih.gov/pubmed/29250590
http://dx.doi.org/10.1007/s41315-017-0039-1
work_keys_str_mv AT turanmehmet adeeplearningbasedfusionofrgbcamerainformationandmagneticlocalizationinformationforendoscopiccapsulerobots
AT shabbirjahanzaib adeeplearningbasedfusionofrgbcamerainformationandmagneticlocalizationinformationforendoscopiccapsulerobots
AT araujohelder adeeplearningbasedfusionofrgbcamerainformationandmagneticlocalizationinformationforendoscopiccapsulerobots
AT konukogluender adeeplearningbasedfusionofrgbcamerainformationandmagneticlocalizationinformationforendoscopiccapsulerobots
AT sittimetin adeeplearningbasedfusionofrgbcamerainformationandmagneticlocalizationinformationforendoscopiccapsulerobots
AT turanmehmet deeplearningbasedfusionofrgbcamerainformationandmagneticlocalizationinformationforendoscopiccapsulerobots
AT shabbirjahanzaib deeplearningbasedfusionofrgbcamerainformationandmagneticlocalizationinformationforendoscopiccapsulerobots
AT araujohelder deeplearningbasedfusionofrgbcamerainformationandmagneticlocalizationinformationforendoscopiccapsulerobots
AT konukogluender deeplearningbasedfusionofrgbcamerainformationandmagneticlocalizationinformationforendoscopiccapsulerobots
AT sittimetin deeplearningbasedfusionofrgbcamerainformationandmagneticlocalizationinformationforendoscopiccapsulerobots

Ejemplares similares