Cargando…
Diagnostic test accuracy of machine learning algorithms for the detection intracranial hemorrhage: a systematic review and meta-analysis study
BACKGROUND: This systematic review and meta-analysis were conducted to objectively evaluate the evidence of machine learning (ML) in the patient diagnosis of Intracranial Hemorrhage (ICH) on computed tomography (CT) scans. METHODS: Until May 2023, systematic searches were conducted in ISI Web of Sci...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10694901/ http://dx.doi.org/10.1186/s12938-023-01172-1 |
_version_ | 1785153476236410880 |
---|---|
author | Maghami, Masoud Sattari, Shahab Aldin Tahmasbi, Marziyeh Panahi, Pegah Mozafari, Javad Shirbandi, Kiarash |
author_facet | Maghami, Masoud Sattari, Shahab Aldin Tahmasbi, Marziyeh Panahi, Pegah Mozafari, Javad Shirbandi, Kiarash |
author_sort | Maghami, Masoud |
collection | PubMed |
description | BACKGROUND: This systematic review and meta-analysis were conducted to objectively evaluate the evidence of machine learning (ML) in the patient diagnosis of Intracranial Hemorrhage (ICH) on computed tomography (CT) scans. METHODS: Until May 2023, systematic searches were conducted in ISI Web of Science, PubMed, Scopus, Cochrane Library, IEEE Xplore Digital Library, CINAHL, Science Direct, PROSPERO, and EMBASE for studies that evaluated the diagnostic precision of ML model-assisted ICH detection. Patients with and without ICH as the target condition who were receiving CT-Scan were eligible for the research, which used ML algorithms based on radiologists' reports as the gold reference standard. For meta-analysis, pooled sensitivities, specificities, and a summary receiver operating characteristics curve (SROC) were used. RESULTS: At last, after screening the title, abstract, and full paper, twenty-six retrospective and three prospective, and two retrospective/prospective studies were included. The overall (Diagnostic Test Accuracy) DTA of retrospective studies with a pooled sensitivity was 0.917 (95% CI 0.88–0.943, I(2) = 99%). The pooled specificity was 0.945 (95% CI 0.918–0.964, I(2) = 100%). The pooled diagnostic odds ratio (DOR) was 219.47 (95% CI 104.78–459.66, I(2) = 100%). These results were significant for the specificity of the different network architecture models (p-value = 0.0289). However, the results for sensitivity (p-value = 0.6417) and DOR (p-value = 0.2187) were not significant. The ResNet algorithm has higher pooled specificity than other algorithms with 0.935 (95% CI 0.854–0.973, I(2) = 93%). CONCLUSION: This meta-analysis on DTA of ML algorithms for detecting ICH by assessing non-contrast CT-Scans shows the ML has an acceptable performance in diagnosing ICH. Using ResNet in ICH detection remains promising prediction was improved via training in an Architecture Learning Network (ALN). SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12938-023-01172-1. |
format | Online Article Text |
id | pubmed-10694901 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-106949012023-12-05 Diagnostic test accuracy of machine learning algorithms for the detection intracranial hemorrhage: a systematic review and meta-analysis study Maghami, Masoud Sattari, Shahab Aldin Tahmasbi, Marziyeh Panahi, Pegah Mozafari, Javad Shirbandi, Kiarash Biomed Eng Online Review BACKGROUND: This systematic review and meta-analysis were conducted to objectively evaluate the evidence of machine learning (ML) in the patient diagnosis of Intracranial Hemorrhage (ICH) on computed tomography (CT) scans. METHODS: Until May 2023, systematic searches were conducted in ISI Web of Science, PubMed, Scopus, Cochrane Library, IEEE Xplore Digital Library, CINAHL, Science Direct, PROSPERO, and EMBASE for studies that evaluated the diagnostic precision of ML model-assisted ICH detection. Patients with and without ICH as the target condition who were receiving CT-Scan were eligible for the research, which used ML algorithms based on radiologists' reports as the gold reference standard. For meta-analysis, pooled sensitivities, specificities, and a summary receiver operating characteristics curve (SROC) were used. RESULTS: At last, after screening the title, abstract, and full paper, twenty-six retrospective and three prospective, and two retrospective/prospective studies were included. The overall (Diagnostic Test Accuracy) DTA of retrospective studies with a pooled sensitivity was 0.917 (95% CI 0.88–0.943, I(2) = 99%). The pooled specificity was 0.945 (95% CI 0.918–0.964, I(2) = 100%). The pooled diagnostic odds ratio (DOR) was 219.47 (95% CI 104.78–459.66, I(2) = 100%). These results were significant for the specificity of the different network architecture models (p-value = 0.0289). However, the results for sensitivity (p-value = 0.6417) and DOR (p-value = 0.2187) were not significant. The ResNet algorithm has higher pooled specificity than other algorithms with 0.935 (95% CI 0.854–0.973, I(2) = 93%). CONCLUSION: This meta-analysis on DTA of ML algorithms for detecting ICH by assessing non-contrast CT-Scans shows the ML has an acceptable performance in diagnosing ICH. Using ResNet in ICH detection remains promising prediction was improved via training in an Architecture Learning Network (ALN). SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12938-023-01172-1. BioMed Central 2023-12-04 /pmc/articles/PMC10694901/ http://dx.doi.org/10.1186/s12938-023-01172-1 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Review Maghami, Masoud Sattari, Shahab Aldin Tahmasbi, Marziyeh Panahi, Pegah Mozafari, Javad Shirbandi, Kiarash Diagnostic test accuracy of machine learning algorithms for the detection intracranial hemorrhage: a systematic review and meta-analysis study |
title | Diagnostic test accuracy of machine learning algorithms for the detection intracranial hemorrhage: a systematic review and meta-analysis study |
title_full | Diagnostic test accuracy of machine learning algorithms for the detection intracranial hemorrhage: a systematic review and meta-analysis study |
title_fullStr | Diagnostic test accuracy of machine learning algorithms for the detection intracranial hemorrhage: a systematic review and meta-analysis study |
title_full_unstemmed | Diagnostic test accuracy of machine learning algorithms for the detection intracranial hemorrhage: a systematic review and meta-analysis study |
title_short | Diagnostic test accuracy of machine learning algorithms for the detection intracranial hemorrhage: a systematic review and meta-analysis study |
title_sort | diagnostic test accuracy of machine learning algorithms for the detection intracranial hemorrhage: a systematic review and meta-analysis study |
topic | Review |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10694901/ http://dx.doi.org/10.1186/s12938-023-01172-1 |
work_keys_str_mv | AT maghamimasoud diagnostictestaccuracyofmachinelearningalgorithmsforthedetectionintracranialhemorrhageasystematicreviewandmetaanalysisstudy AT sattarishahabaldin diagnostictestaccuracyofmachinelearningalgorithmsforthedetectionintracranialhemorrhageasystematicreviewandmetaanalysisstudy AT tahmasbimarziyeh diagnostictestaccuracyofmachinelearningalgorithmsforthedetectionintracranialhemorrhageasystematicreviewandmetaanalysisstudy AT panahipegah diagnostictestaccuracyofmachinelearningalgorithmsforthedetectionintracranialhemorrhageasystematicreviewandmetaanalysisstudy AT mozafarijavad diagnostictestaccuracyofmachinelearningalgorithmsforthedetectionintracranialhemorrhageasystematicreviewandmetaanalysisstudy AT shirbandikiarash diagnostictestaccuracyofmachinelearningalgorithmsforthedetectionintracranialhemorrhageasystematicreviewandmetaanalysisstudy |