Cargando…

Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery

PURPOSE: A fundamental problem in designing safe machine learning systems is identifying when samples presented to a deployed model differ from those observed at training time. Detecting so-called out-of-distribution (OoD) samples is crucial in safety-critical applications such as robotically guided...

Descripción completa

Detalles Bibliográficos
Autores principales: Jungo, Alain, Doorenbos, Lars, Da Col, Tommaso, Beelen, Maarten, Zinkernagel, Martin, Márquez-Neila, Pablo, Sznitman, Raphael
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10285003/
https://www.ncbi.nlm.nih.gov/pubmed/37133678
http://dx.doi.org/10.1007/s11548-023-02909-y
_version_ 1785061516146376704
author Jungo, Alain
Doorenbos, Lars
Da Col, Tommaso
Beelen, Maarten
Zinkernagel, Martin
Márquez-Neila, Pablo
Sznitman, Raphael
author_facet Jungo, Alain
Doorenbos, Lars
Da Col, Tommaso
Beelen, Maarten
Zinkernagel, Martin
Márquez-Neila, Pablo
Sznitman, Raphael
author_sort Jungo, Alain
collection PubMed
description PURPOSE: A fundamental problem in designing safe machine learning systems is identifying when samples presented to a deployed model differ from those observed at training time. Detecting so-called out-of-distribution (OoD) samples is crucial in safety-critical applications such as robotically guided retinal microsurgery, where distances between the instrument and the retina are derived from sequences of 1D images that are acquired by an instrument-integrated optical coherence tomography (iiOCT) probe. METHODS: This work investigates the feasibility of using an OoD detector to identify when images from the iiOCT probe are inappropriate for subsequent machine learning-based distance estimation. We show how a simple OoD detector based on the Mahalanobis distance can successfully reject corrupted samples coming from real-world ex vivo porcine eyes. RESULTS: Our results demonstrate that the proposed approach can successfully detect OoD samples and help maintain the performance of the downstream task within reasonable levels. MahaAD outperformed a supervised approach trained on the same kind of corruptions and achieved the best performance in detecting OoD cases from a collection of iiOCT samples with real-world corruptions. CONCLUSION: The results indicate that detecting corrupted iiOCT data through OoD detection is feasible and does not need prior knowledge of possible corruptions. Consequently, MahaAD could aid in ensuring patient safety during robotically guided microsurgery by preventing deployed prediction models from estimating distances that put the patient at risk.
format Online
Article
Text
id pubmed-10285003
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-102850032023-06-23 Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery Jungo, Alain Doorenbos, Lars Da Col, Tommaso Beelen, Maarten Zinkernagel, Martin Márquez-Neila, Pablo Sznitman, Raphael Int J Comput Assist Radiol Surg Original Article PURPOSE: A fundamental problem in designing safe machine learning systems is identifying when samples presented to a deployed model differ from those observed at training time. Detecting so-called out-of-distribution (OoD) samples is crucial in safety-critical applications such as robotically guided retinal microsurgery, where distances between the instrument and the retina are derived from sequences of 1D images that are acquired by an instrument-integrated optical coherence tomography (iiOCT) probe. METHODS: This work investigates the feasibility of using an OoD detector to identify when images from the iiOCT probe are inappropriate for subsequent machine learning-based distance estimation. We show how a simple OoD detector based on the Mahalanobis distance can successfully reject corrupted samples coming from real-world ex vivo porcine eyes. RESULTS: Our results demonstrate that the proposed approach can successfully detect OoD samples and help maintain the performance of the downstream task within reasonable levels. MahaAD outperformed a supervised approach trained on the same kind of corruptions and achieved the best performance in detecting OoD cases from a collection of iiOCT samples with real-world corruptions. CONCLUSION: The results indicate that detecting corrupted iiOCT data through OoD detection is feasible and does not need prior knowledge of possible corruptions. Consequently, MahaAD could aid in ensuring patient safety during robotically guided microsurgery by preventing deployed prediction models from estimating distances that put the patient at risk. Springer International Publishing 2023-05-03 2023 /pmc/articles/PMC10285003/ /pubmed/37133678 http://dx.doi.org/10.1007/s11548-023-02909-y Text en © The Author(s) 2023, corrected publication 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Original Article
Jungo, Alain
Doorenbos, Lars
Da Col, Tommaso
Beelen, Maarten
Zinkernagel, Martin
Márquez-Neila, Pablo
Sznitman, Raphael
Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery
title Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery
title_full Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery
title_fullStr Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery
title_full_unstemmed Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery
title_short Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery
title_sort unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery
topic Original Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10285003/
https://www.ncbi.nlm.nih.gov/pubmed/37133678
http://dx.doi.org/10.1007/s11548-023-02909-y
work_keys_str_mv AT jungoalain unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery
AT doorenboslars unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery
AT dacoltommaso unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery
AT beelenmaarten unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery
AT zinkernagelmartin unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery
AT marquezneilapablo unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery
AT sznitmanraphael unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery