Cargando…

Conventional Versus Artificial Intelligence-Assisted Interpretation of Chest Radiographs in Patients With Acute Respiratory Symptoms in Emergency Department: A Pragmatic Randomized Clinical Trial

OBJECTIVE: It is unknown whether artificial intelligence-based computer-aided detection (AI-CAD) can enhance the accuracy of chest radiograph (CR) interpretation in real-world clinical practice. We aimed to compare the accuracy of CR interpretation assisted by AI-CAD to that of conventional interpre...

Descripción completa

Detalles Bibliográficos
Autores principales: Hwang, Eui Jin, Goo, Jin Mo, Nam, Ju Gang, Park, Chang Min, Hong, Ki Jeong, Kim, Ki Hong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Korean Society of Radiology 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9971841/
https://www.ncbi.nlm.nih.gov/pubmed/36788769
http://dx.doi.org/10.3348/kjr.2022.0651
_version_ 1784898187202396160
author Hwang, Eui Jin
Goo, Jin Mo
Nam, Ju Gang
Park, Chang Min
Hong, Ki Jeong
Kim, Ki Hong
author_facet Hwang, Eui Jin
Goo, Jin Mo
Nam, Ju Gang
Park, Chang Min
Hong, Ki Jeong
Kim, Ki Hong
author_sort Hwang, Eui Jin
collection PubMed
description OBJECTIVE: It is unknown whether artificial intelligence-based computer-aided detection (AI-CAD) can enhance the accuracy of chest radiograph (CR) interpretation in real-world clinical practice. We aimed to compare the accuracy of CR interpretation assisted by AI-CAD to that of conventional interpretation in patients who presented to the emergency department (ED) with acute respiratory symptoms using a pragmatic randomized controlled trial. MATERIALS AND METHODS: Patients who underwent CRs for acute respiratory symptoms at the ED of a tertiary referral institution were randomly assigned to intervention group (with assistance from an AI-CAD for CR interpretation) or control group (without AI assistance). Using a commercial AI-CAD system (Lunit INSIGHT CXR, version 2.0.2.0; Lunit Inc.). Other clinical practices were consistent with standard procedures. Sensitivity and false-positive rates of CR interpretation by duty trainee radiologists for identifying acute thoracic diseases were the primary and secondary outcomes, respectively. The reference standards for acute thoracic disease were established based on a review of the patient’s medical record at least 30 days after the ED visit. RESULTS: We randomly assigned 3576 participants to either the intervention group (1761 participants; mean age ± standard deviation, 65 ± 17 years; 978 males; acute thoracic disease in 472 participants) or the control group (1815 participants; 64 ± 17 years; 988 males; acute thoracic disease in 491 participants). The sensitivity (67.2% [317/472] in the intervention group vs. 66.0% [324/491] in the control group; odds ratio, 1.02 [95% confidence interval, 0.70–1.49]; P = 0.917) and false-positive rate (19.3% [249/1289] vs. 18.5% [245/1324]; odds ratio, 1.00 [95% confidence interval, 0.79–1.26]; P = 0.985) of CR interpretation by duty radiologists were not associated with the use of AI-CAD. CONCLUSION: AI-CAD did not improve the sensitivity and false-positive rate of CR interpretation for diagnosing acute thoracic disease in patients with acute respiratory symptoms who presented to the ED.
format Online
Article
Text
id pubmed-9971841
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher The Korean Society of Radiology
record_format MEDLINE/PubMed
spelling pubmed-99718412023-03-01 Conventional Versus Artificial Intelligence-Assisted Interpretation of Chest Radiographs in Patients With Acute Respiratory Symptoms in Emergency Department: A Pragmatic Randomized Clinical Trial Hwang, Eui Jin Goo, Jin Mo Nam, Ju Gang Park, Chang Min Hong, Ki Jeong Kim, Ki Hong Korean J Radiol Thoracic Imaging OBJECTIVE: It is unknown whether artificial intelligence-based computer-aided detection (AI-CAD) can enhance the accuracy of chest radiograph (CR) interpretation in real-world clinical practice. We aimed to compare the accuracy of CR interpretation assisted by AI-CAD to that of conventional interpretation in patients who presented to the emergency department (ED) with acute respiratory symptoms using a pragmatic randomized controlled trial. MATERIALS AND METHODS: Patients who underwent CRs for acute respiratory symptoms at the ED of a tertiary referral institution were randomly assigned to intervention group (with assistance from an AI-CAD for CR interpretation) or control group (without AI assistance). Using a commercial AI-CAD system (Lunit INSIGHT CXR, version 2.0.2.0; Lunit Inc.). Other clinical practices were consistent with standard procedures. Sensitivity and false-positive rates of CR interpretation by duty trainee radiologists for identifying acute thoracic diseases were the primary and secondary outcomes, respectively. The reference standards for acute thoracic disease were established based on a review of the patient’s medical record at least 30 days after the ED visit. RESULTS: We randomly assigned 3576 participants to either the intervention group (1761 participants; mean age ± standard deviation, 65 ± 17 years; 978 males; acute thoracic disease in 472 participants) or the control group (1815 participants; 64 ± 17 years; 988 males; acute thoracic disease in 491 participants). The sensitivity (67.2% [317/472] in the intervention group vs. 66.0% [324/491] in the control group; odds ratio, 1.02 [95% confidence interval, 0.70–1.49]; P = 0.917) and false-positive rate (19.3% [249/1289] vs. 18.5% [245/1324]; odds ratio, 1.00 [95% confidence interval, 0.79–1.26]; P = 0.985) of CR interpretation by duty radiologists were not associated with the use of AI-CAD. CONCLUSION: AI-CAD did not improve the sensitivity and false-positive rate of CR interpretation for diagnosing acute thoracic disease in patients with acute respiratory symptoms who presented to the ED. The Korean Society of Radiology 2023-03 2023-02-06 /pmc/articles/PMC9971841/ /pubmed/36788769 http://dx.doi.org/10.3348/kjr.2022.0651 Text en Copyright © 2023 The Korean Society of Radiology https://creativecommons.org/licenses/by-nc/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (https://creativecommons.org/licenses/by-nc/4.0 (https://creativecommons.org/licenses/by-nc/4.0/) ) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Thoracic Imaging
Hwang, Eui Jin
Goo, Jin Mo
Nam, Ju Gang
Park, Chang Min
Hong, Ki Jeong
Kim, Ki Hong
Conventional Versus Artificial Intelligence-Assisted Interpretation of Chest Radiographs in Patients With Acute Respiratory Symptoms in Emergency Department: A Pragmatic Randomized Clinical Trial
title Conventional Versus Artificial Intelligence-Assisted Interpretation of Chest Radiographs in Patients With Acute Respiratory Symptoms in Emergency Department: A Pragmatic Randomized Clinical Trial
title_full Conventional Versus Artificial Intelligence-Assisted Interpretation of Chest Radiographs in Patients With Acute Respiratory Symptoms in Emergency Department: A Pragmatic Randomized Clinical Trial
title_fullStr Conventional Versus Artificial Intelligence-Assisted Interpretation of Chest Radiographs in Patients With Acute Respiratory Symptoms in Emergency Department: A Pragmatic Randomized Clinical Trial
title_full_unstemmed Conventional Versus Artificial Intelligence-Assisted Interpretation of Chest Radiographs in Patients With Acute Respiratory Symptoms in Emergency Department: A Pragmatic Randomized Clinical Trial
title_short Conventional Versus Artificial Intelligence-Assisted Interpretation of Chest Radiographs in Patients With Acute Respiratory Symptoms in Emergency Department: A Pragmatic Randomized Clinical Trial
title_sort conventional versus artificial intelligence-assisted interpretation of chest radiographs in patients with acute respiratory symptoms in emergency department: a pragmatic randomized clinical trial
topic Thoracic Imaging
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9971841/
https://www.ncbi.nlm.nih.gov/pubmed/36788769
http://dx.doi.org/10.3348/kjr.2022.0651
work_keys_str_mv AT hwangeuijin conventionalversusartificialintelligenceassistedinterpretationofchestradiographsinpatientswithacuterespiratorysymptomsinemergencydepartmentapragmaticrandomizedclinicaltrial
AT goojinmo conventionalversusartificialintelligenceassistedinterpretationofchestradiographsinpatientswithacuterespiratorysymptomsinemergencydepartmentapragmaticrandomizedclinicaltrial
AT namjugang conventionalversusartificialintelligenceassistedinterpretationofchestradiographsinpatientswithacuterespiratorysymptomsinemergencydepartmentapragmaticrandomizedclinicaltrial
AT parkchangmin conventionalversusartificialintelligenceassistedinterpretationofchestradiographsinpatientswithacuterespiratorysymptomsinemergencydepartmentapragmaticrandomizedclinicaltrial
AT hongkijeong conventionalversusartificialintelligenceassistedinterpretationofchestradiographsinpatientswithacuterespiratorysymptomsinemergencydepartmentapragmaticrandomizedclinicaltrial
AT kimkihong conventionalversusartificialintelligenceassistedinterpretationofchestradiographsinpatientswithacuterespiratorysymptomsinemergencydepartmentapragmaticrandomizedclinicaltrial