Cargando…

Retrospective analysis and prospective validation of an AI-based software for intracranial haemorrhage detection at a high-volume trauma centre

Rapid detection of intracranial haemorrhage (ICH) is crucial for assessing patients with neurological symptoms. Prioritising these urgent scans for reporting presents a challenge for radiologists. Artificial intelligence (AI) offers a solution to enable radiologists to triage urgent scans and reduce...

Descripción completa

Detalles Bibliográficos
Autores principales: Zia, Adil, Fletcher, Calvin, Bigwood, Shalini, Ratnakanthan, Prasanna, Seah, Jarrel, Lee, Robin, Kavnoudias, Helen, Law, Meng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9674833/
https://www.ncbi.nlm.nih.gov/pubmed/36400834
http://dx.doi.org/10.1038/s41598-022-24504-y
_version_ 1784833235853770752
author Zia, Adil
Fletcher, Calvin
Bigwood, Shalini
Ratnakanthan, Prasanna
Seah, Jarrel
Lee, Robin
Kavnoudias, Helen
Law, Meng
author_facet Zia, Adil
Fletcher, Calvin
Bigwood, Shalini
Ratnakanthan, Prasanna
Seah, Jarrel
Lee, Robin
Kavnoudias, Helen
Law, Meng
author_sort Zia, Adil
collection PubMed
description Rapid detection of intracranial haemorrhage (ICH) is crucial for assessing patients with neurological symptoms. Prioritising these urgent scans for reporting presents a challenge for radiologists. Artificial intelligence (AI) offers a solution to enable radiologists to triage urgent scans and reduce reporting errors. This study aims to evaluate the accuracy of an ICH-detection AI software and whether it benefits a high-volume trauma centre in terms of triage and reducing diagnostic errors. A peer review of head CT scans performed prior to the implementation of the AI was conducted to identify the department’s current miss-rate. Once implemented, the AI software was validated using CT scans performed over one month, and was reviewed by a neuroradiologist. The turn-around-time was calculated as the time taken from scan completion to report finalisation. 2916 head CT scans and reports were reviewed as part of the audit. The AI software flagged 20 cases that were negative-by-report. Two of these were true-misses that had no follow-up imaging. Both patients were followed up and exhibited no long-term neurological sequelae. For ICH-positive scans, there was an increase in TAT in the total sample (35.6%), and a statistically insignificant decrease in TAT in the emergency (− 5.1%) and outpatient (− 14.2%) cohorts. The AI software was tested on a sample of real-world data from a high-volume Australian centre. The diagnostic accuracy was comparable to that reported in literature. The study demonstrated the institution’s low miss-rate and short reporting time, therefore any improvements from the use of AI would be marginal and challenging to measure.
format Online
Article
Text
id pubmed-9674833
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-96748332022-11-20 Retrospective analysis and prospective validation of an AI-based software for intracranial haemorrhage detection at a high-volume trauma centre Zia, Adil Fletcher, Calvin Bigwood, Shalini Ratnakanthan, Prasanna Seah, Jarrel Lee, Robin Kavnoudias, Helen Law, Meng Sci Rep Article Rapid detection of intracranial haemorrhage (ICH) is crucial for assessing patients with neurological symptoms. Prioritising these urgent scans for reporting presents a challenge for radiologists. Artificial intelligence (AI) offers a solution to enable radiologists to triage urgent scans and reduce reporting errors. This study aims to evaluate the accuracy of an ICH-detection AI software and whether it benefits a high-volume trauma centre in terms of triage and reducing diagnostic errors. A peer review of head CT scans performed prior to the implementation of the AI was conducted to identify the department’s current miss-rate. Once implemented, the AI software was validated using CT scans performed over one month, and was reviewed by a neuroradiologist. The turn-around-time was calculated as the time taken from scan completion to report finalisation. 2916 head CT scans and reports were reviewed as part of the audit. The AI software flagged 20 cases that were negative-by-report. Two of these were true-misses that had no follow-up imaging. Both patients were followed up and exhibited no long-term neurological sequelae. For ICH-positive scans, there was an increase in TAT in the total sample (35.6%), and a statistically insignificant decrease in TAT in the emergency (− 5.1%) and outpatient (− 14.2%) cohorts. The AI software was tested on a sample of real-world data from a high-volume Australian centre. The diagnostic accuracy was comparable to that reported in literature. The study demonstrated the institution’s low miss-rate and short reporting time, therefore any improvements from the use of AI would be marginal and challenging to measure. Nature Publishing Group UK 2022-11-18 /pmc/articles/PMC9674833/ /pubmed/36400834 http://dx.doi.org/10.1038/s41598-022-24504-y Text en © Crown 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Zia, Adil
Fletcher, Calvin
Bigwood, Shalini
Ratnakanthan, Prasanna
Seah, Jarrel
Lee, Robin
Kavnoudias, Helen
Law, Meng
Retrospective analysis and prospective validation of an AI-based software for intracranial haemorrhage detection at a high-volume trauma centre
title Retrospective analysis and prospective validation of an AI-based software for intracranial haemorrhage detection at a high-volume trauma centre
title_full Retrospective analysis and prospective validation of an AI-based software for intracranial haemorrhage detection at a high-volume trauma centre
title_fullStr Retrospective analysis and prospective validation of an AI-based software for intracranial haemorrhage detection at a high-volume trauma centre
title_full_unstemmed Retrospective analysis and prospective validation of an AI-based software for intracranial haemorrhage detection at a high-volume trauma centre
title_short Retrospective analysis and prospective validation of an AI-based software for intracranial haemorrhage detection at a high-volume trauma centre
title_sort retrospective analysis and prospective validation of an ai-based software for intracranial haemorrhage detection at a high-volume trauma centre
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9674833/
https://www.ncbi.nlm.nih.gov/pubmed/36400834
http://dx.doi.org/10.1038/s41598-022-24504-y
work_keys_str_mv AT ziaadil retrospectiveanalysisandprospectivevalidationofanaibasedsoftwareforintracranialhaemorrhagedetectionatahighvolumetraumacentre
AT fletchercalvin retrospectiveanalysisandprospectivevalidationofanaibasedsoftwareforintracranialhaemorrhagedetectionatahighvolumetraumacentre
AT bigwoodshalini retrospectiveanalysisandprospectivevalidationofanaibasedsoftwareforintracranialhaemorrhagedetectionatahighvolumetraumacentre
AT ratnakanthanprasanna retrospectiveanalysisandprospectivevalidationofanaibasedsoftwareforintracranialhaemorrhagedetectionatahighvolumetraumacentre
AT seahjarrel retrospectiveanalysisandprospectivevalidationofanaibasedsoftwareforintracranialhaemorrhagedetectionatahighvolumetraumacentre
AT leerobin retrospectiveanalysisandprospectivevalidationofanaibasedsoftwareforintracranialhaemorrhagedetectionatahighvolumetraumacentre
AT kavnoudiashelen retrospectiveanalysisandprospectivevalidationofanaibasedsoftwareforintracranialhaemorrhagedetectionatahighvolumetraumacentre
AT lawmeng retrospectiveanalysisandprospectivevalidationofanaibasedsoftwareforintracranialhaemorrhagedetectionatahighvolumetraumacentre