Cargando…

Faster and Better: How Anomaly Detection Can Accelerate and Improve Reporting of Head Computed Tomography

Background: Most artificial intelligence (AI) systems are restricted to solving a pre-defined task, thus limiting their generalizability to unselected datasets. Anomaly detection relieves this shortfall by flagging all pathologies as deviations from a learned norm. Here, we investigate whether diagn...

Descripción completa

Detalles Bibliográficos
Autores principales: Finck, Tom, Moosbauer, Julia, Probst, Monika, Schlaeger, Sarah, Schuberth, Madeleine, Schinz, David, Yiğitsoy, Mehmet, Byas, Sebastian, Zimmer, Claus, Pfister, Franz, Wiestler, Benedikt
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8871235/
https://www.ncbi.nlm.nih.gov/pubmed/35204543
http://dx.doi.org/10.3390/diagnostics12020452
_version_ 1784656948531036160
author Finck, Tom
Moosbauer, Julia
Probst, Monika
Schlaeger, Sarah
Schuberth, Madeleine
Schinz, David
Yiğitsoy, Mehmet
Byas, Sebastian
Zimmer, Claus
Pfister, Franz
Wiestler, Benedikt
author_facet Finck, Tom
Moosbauer, Julia
Probst, Monika
Schlaeger, Sarah
Schuberth, Madeleine
Schinz, David
Yiğitsoy, Mehmet
Byas, Sebastian
Zimmer, Claus
Pfister, Franz
Wiestler, Benedikt
author_sort Finck, Tom
collection PubMed
description Background: Most artificial intelligence (AI) systems are restricted to solving a pre-defined task, thus limiting their generalizability to unselected datasets. Anomaly detection relieves this shortfall by flagging all pathologies as deviations from a learned norm. Here, we investigate whether diagnostic accuracy and reporting times can be improved by an anomaly detection tool for head computed tomography (CT), tailored to provide patient-level triage and voxel-based highlighting of pathologies. Methods: Four neuroradiologists with 1–10 years of experience each investigated a set of 80 routinely acquired head CTs containing 40 normal scans and 40 scans with common pathologies. In a random order, scans were investigated with and without AI-predictions. A 4-week wash-out period between runs was included to prevent a reminiscence effect. Performance metrics for identifying pathologies, reporting times, and subjectively assessed diagnostic confidence were determined for both runs. Results: AI-support significantly increased the share of correctly classified scans (normal/pathological) from 309/320 scans to 317/320 scans (p = 0.0045), with a corresponding sensitivity, specificity, negative- and positive- predictive value of 100%, 98.1%, 98.2% and 100%, respectively. Further, reporting was significantly accelerated with AI-support, as evidenced by the 15.7% reduction in reporting times (65.1 ± 8.9 s vs. 54.9 ± 7.1 s; p < 0.0001). Diagnostic confidence was similar in both runs. Conclusion: Our study shows that AI-based triage of CTs can improve the diagnostic accuracy and accelerate reporting for experienced and inexperienced radiologists alike. Through ad hoc identification of normal CTs, anomaly detection promises to guide clinicians towards scans requiring urgent attention.
format Online
Article
Text
id pubmed-8871235
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-88712352022-02-25 Faster and Better: How Anomaly Detection Can Accelerate and Improve Reporting of Head Computed Tomography Finck, Tom Moosbauer, Julia Probst, Monika Schlaeger, Sarah Schuberth, Madeleine Schinz, David Yiğitsoy, Mehmet Byas, Sebastian Zimmer, Claus Pfister, Franz Wiestler, Benedikt Diagnostics (Basel) Article Background: Most artificial intelligence (AI) systems are restricted to solving a pre-defined task, thus limiting their generalizability to unselected datasets. Anomaly detection relieves this shortfall by flagging all pathologies as deviations from a learned norm. Here, we investigate whether diagnostic accuracy and reporting times can be improved by an anomaly detection tool for head computed tomography (CT), tailored to provide patient-level triage and voxel-based highlighting of pathologies. Methods: Four neuroradiologists with 1–10 years of experience each investigated a set of 80 routinely acquired head CTs containing 40 normal scans and 40 scans with common pathologies. In a random order, scans were investigated with and without AI-predictions. A 4-week wash-out period between runs was included to prevent a reminiscence effect. Performance metrics for identifying pathologies, reporting times, and subjectively assessed diagnostic confidence were determined for both runs. Results: AI-support significantly increased the share of correctly classified scans (normal/pathological) from 309/320 scans to 317/320 scans (p = 0.0045), with a corresponding sensitivity, specificity, negative- and positive- predictive value of 100%, 98.1%, 98.2% and 100%, respectively. Further, reporting was significantly accelerated with AI-support, as evidenced by the 15.7% reduction in reporting times (65.1 ± 8.9 s vs. 54.9 ± 7.1 s; p < 0.0001). Diagnostic confidence was similar in both runs. Conclusion: Our study shows that AI-based triage of CTs can improve the diagnostic accuracy and accelerate reporting for experienced and inexperienced radiologists alike. Through ad hoc identification of normal CTs, anomaly detection promises to guide clinicians towards scans requiring urgent attention. MDPI 2022-02-10 /pmc/articles/PMC8871235/ /pubmed/35204543 http://dx.doi.org/10.3390/diagnostics12020452 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Finck, Tom
Moosbauer, Julia
Probst, Monika
Schlaeger, Sarah
Schuberth, Madeleine
Schinz, David
Yiğitsoy, Mehmet
Byas, Sebastian
Zimmer, Claus
Pfister, Franz
Wiestler, Benedikt
Faster and Better: How Anomaly Detection Can Accelerate and Improve Reporting of Head Computed Tomography
title Faster and Better: How Anomaly Detection Can Accelerate and Improve Reporting of Head Computed Tomography
title_full Faster and Better: How Anomaly Detection Can Accelerate and Improve Reporting of Head Computed Tomography
title_fullStr Faster and Better: How Anomaly Detection Can Accelerate and Improve Reporting of Head Computed Tomography
title_full_unstemmed Faster and Better: How Anomaly Detection Can Accelerate and Improve Reporting of Head Computed Tomography
title_short Faster and Better: How Anomaly Detection Can Accelerate and Improve Reporting of Head Computed Tomography
title_sort faster and better: how anomaly detection can accelerate and improve reporting of head computed tomography
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8871235/
https://www.ncbi.nlm.nih.gov/pubmed/35204543
http://dx.doi.org/10.3390/diagnostics12020452
work_keys_str_mv AT fincktom fasterandbetterhowanomalydetectioncanaccelerateandimprovereportingofheadcomputedtomography
AT moosbauerjulia fasterandbetterhowanomalydetectioncanaccelerateandimprovereportingofheadcomputedtomography
AT probstmonika fasterandbetterhowanomalydetectioncanaccelerateandimprovereportingofheadcomputedtomography
AT schlaegersarah fasterandbetterhowanomalydetectioncanaccelerateandimprovereportingofheadcomputedtomography
AT schuberthmadeleine fasterandbetterhowanomalydetectioncanaccelerateandimprovereportingofheadcomputedtomography
AT schinzdavid fasterandbetterhowanomalydetectioncanaccelerateandimprovereportingofheadcomputedtomography
AT yigitsoymehmet fasterandbetterhowanomalydetectioncanaccelerateandimprovereportingofheadcomputedtomography
AT byassebastian fasterandbetterhowanomalydetectioncanaccelerateandimprovereportingofheadcomputedtomography
AT zimmerclaus fasterandbetterhowanomalydetectioncanaccelerateandimprovereportingofheadcomputedtomography
AT pfisterfranz fasterandbetterhowanomalydetectioncanaccelerateandimprovereportingofheadcomputedtomography
AT wiestlerbenedikt fasterandbetterhowanomalydetectioncanaccelerateandimprovereportingofheadcomputedtomography