Cargando…
Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery
PURPOSE: A fundamental problem in designing safe machine learning systems is identifying when samples presented to a deployed model differ from those observed at training time. Detecting so-called out-of-distribution (OoD) samples is crucial in safety-critical applications such as robotically guided...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer International Publishing
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10285003/ https://www.ncbi.nlm.nih.gov/pubmed/37133678 http://dx.doi.org/10.1007/s11548-023-02909-y |
_version_ | 1785061516146376704 |
---|---|
author | Jungo, Alain Doorenbos, Lars Da Col, Tommaso Beelen, Maarten Zinkernagel, Martin Márquez-Neila, Pablo Sznitman, Raphael |
author_facet | Jungo, Alain Doorenbos, Lars Da Col, Tommaso Beelen, Maarten Zinkernagel, Martin Márquez-Neila, Pablo Sznitman, Raphael |
author_sort | Jungo, Alain |
collection | PubMed |
description | PURPOSE: A fundamental problem in designing safe machine learning systems is identifying when samples presented to a deployed model differ from those observed at training time. Detecting so-called out-of-distribution (OoD) samples is crucial in safety-critical applications such as robotically guided retinal microsurgery, where distances between the instrument and the retina are derived from sequences of 1D images that are acquired by an instrument-integrated optical coherence tomography (iiOCT) probe. METHODS: This work investigates the feasibility of using an OoD detector to identify when images from the iiOCT probe are inappropriate for subsequent machine learning-based distance estimation. We show how a simple OoD detector based on the Mahalanobis distance can successfully reject corrupted samples coming from real-world ex vivo porcine eyes. RESULTS: Our results demonstrate that the proposed approach can successfully detect OoD samples and help maintain the performance of the downstream task within reasonable levels. MahaAD outperformed a supervised approach trained on the same kind of corruptions and achieved the best performance in detecting OoD cases from a collection of iiOCT samples with real-world corruptions. CONCLUSION: The results indicate that detecting corrupted iiOCT data through OoD detection is feasible and does not need prior knowledge of possible corruptions. Consequently, MahaAD could aid in ensuring patient safety during robotically guided microsurgery by preventing deployed prediction models from estimating distances that put the patient at risk. |
format | Online Article Text |
id | pubmed-10285003 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Springer International Publishing |
record_format | MEDLINE/PubMed |
spelling | pubmed-102850032023-06-23 Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery Jungo, Alain Doorenbos, Lars Da Col, Tommaso Beelen, Maarten Zinkernagel, Martin Márquez-Neila, Pablo Sznitman, Raphael Int J Comput Assist Radiol Surg Original Article PURPOSE: A fundamental problem in designing safe machine learning systems is identifying when samples presented to a deployed model differ from those observed at training time. Detecting so-called out-of-distribution (OoD) samples is crucial in safety-critical applications such as robotically guided retinal microsurgery, where distances between the instrument and the retina are derived from sequences of 1D images that are acquired by an instrument-integrated optical coherence tomography (iiOCT) probe. METHODS: This work investigates the feasibility of using an OoD detector to identify when images from the iiOCT probe are inappropriate for subsequent machine learning-based distance estimation. We show how a simple OoD detector based on the Mahalanobis distance can successfully reject corrupted samples coming from real-world ex vivo porcine eyes. RESULTS: Our results demonstrate that the proposed approach can successfully detect OoD samples and help maintain the performance of the downstream task within reasonable levels. MahaAD outperformed a supervised approach trained on the same kind of corruptions and achieved the best performance in detecting OoD cases from a collection of iiOCT samples with real-world corruptions. CONCLUSION: The results indicate that detecting corrupted iiOCT data through OoD detection is feasible and does not need prior knowledge of possible corruptions. Consequently, MahaAD could aid in ensuring patient safety during robotically guided microsurgery by preventing deployed prediction models from estimating distances that put the patient at risk. Springer International Publishing 2023-05-03 2023 /pmc/articles/PMC10285003/ /pubmed/37133678 http://dx.doi.org/10.1007/s11548-023-02909-y Text en © The Author(s) 2023, corrected publication 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Original Article Jungo, Alain Doorenbos, Lars Da Col, Tommaso Beelen, Maarten Zinkernagel, Martin Márquez-Neila, Pablo Sznitman, Raphael Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery |
title | Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery |
title_full | Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery |
title_fullStr | Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery |
title_full_unstemmed | Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery |
title_short | Unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery |
title_sort | unsupervised out-of-distribution detection for safer robotically guided retinal microsurgery |
topic | Original Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10285003/ https://www.ncbi.nlm.nih.gov/pubmed/37133678 http://dx.doi.org/10.1007/s11548-023-02909-y |
work_keys_str_mv | AT jungoalain unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery AT doorenboslars unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery AT dacoltommaso unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery AT beelenmaarten unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery AT zinkernagelmartin unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery AT marquezneilapablo unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery AT sznitmanraphael unsupervisedoutofdistributiondetectionforsaferroboticallyguidedretinalmicrosurgery |