Cargando…

Pivotal Clinical Study to Evaluate the Efficacy and Safety of Assistive Artificial Intelligence-Based Software for Cervical Cancer Diagnosis

Colposcopy is the gold standard diagnostic tool for identifying cervical lesions. However, the accuracy of colposcopies depends on the proficiency of the colposcopist. Machine learning algorithms using an artificial intelligence (AI) system can quickly process large amounts of data and have been suc...

Descripción completa

Detalles Bibliográficos
Autores principales: Kim, Seongmin, An, Hyonggin, Cho, Hyun-Woong, Min, Kyung-Jin, Hong, Jin-Hwa, Lee, Sanghoon, Song, Jae-Yun, Lee, Jae-Kwan, Lee, Nak-Woo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10298986/
https://www.ncbi.nlm.nih.gov/pubmed/37373717
http://dx.doi.org/10.3390/jcm12124024
_version_ 1785064251833974784
author Kim, Seongmin
An, Hyonggin
Cho, Hyun-Woong
Min, Kyung-Jin
Hong, Jin-Hwa
Lee, Sanghoon
Song, Jae-Yun
Lee, Jae-Kwan
Lee, Nak-Woo
author_facet Kim, Seongmin
An, Hyonggin
Cho, Hyun-Woong
Min, Kyung-Jin
Hong, Jin-Hwa
Lee, Sanghoon
Song, Jae-Yun
Lee, Jae-Kwan
Lee, Nak-Woo
author_sort Kim, Seongmin
collection PubMed
description Colposcopy is the gold standard diagnostic tool for identifying cervical lesions. However, the accuracy of colposcopies depends on the proficiency of the colposcopist. Machine learning algorithms using an artificial intelligence (AI) system can quickly process large amounts of data and have been successfully applied in several clinical situations. This study evaluated the feasibility of an AI system as an assistive tool for diagnosing high-grade cervical intraepithelial neoplasia lesions compared to the human interpretation of cervical images. This two-centered, crossover, double-blind, randomized controlled trial included 886 randomly selected images. Four colposcopists (two proficient and two inexperienced) independently evaluated cervical images, once with and the other time without the aid of the Cerviray AI(®) system (AIDOT, Seoul, Republic of Korea). The AI aid demonstrated improved areas under the curve on the localization receiver-operating characteristic curve compared with the colposcopy impressions of colposcopists (difference 0.12, 95% confidence interval, 0.10–0.14, p < 0.001). Sensitivity and specificity also improved when using the AI system (89.18% vs. 71.33%; p < 0.001, 96.68% vs. 92.16%; p < 0.001, respectively). Additionally, the classification accuracy rate improved with the aid of AI (86.40% vs. 75.45%; p < 0.001). Overall, the AI system could be used as an assistive diagnostic tool for both proficient and inexperienced colposcopists in cervical cancer screenings to estimate the impression and location of pathologic lesions. Further utilization of this system could help inexperienced colposcopists confirm where to perform a biopsy to diagnose high-grade lesions.
format Online
Article
Text
id pubmed-10298986
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-102989862023-06-28 Pivotal Clinical Study to Evaluate the Efficacy and Safety of Assistive Artificial Intelligence-Based Software for Cervical Cancer Diagnosis Kim, Seongmin An, Hyonggin Cho, Hyun-Woong Min, Kyung-Jin Hong, Jin-Hwa Lee, Sanghoon Song, Jae-Yun Lee, Jae-Kwan Lee, Nak-Woo J Clin Med Article Colposcopy is the gold standard diagnostic tool for identifying cervical lesions. However, the accuracy of colposcopies depends on the proficiency of the colposcopist. Machine learning algorithms using an artificial intelligence (AI) system can quickly process large amounts of data and have been successfully applied in several clinical situations. This study evaluated the feasibility of an AI system as an assistive tool for diagnosing high-grade cervical intraepithelial neoplasia lesions compared to the human interpretation of cervical images. This two-centered, crossover, double-blind, randomized controlled trial included 886 randomly selected images. Four colposcopists (two proficient and two inexperienced) independently evaluated cervical images, once with and the other time without the aid of the Cerviray AI(®) system (AIDOT, Seoul, Republic of Korea). The AI aid demonstrated improved areas under the curve on the localization receiver-operating characteristic curve compared with the colposcopy impressions of colposcopists (difference 0.12, 95% confidence interval, 0.10–0.14, p < 0.001). Sensitivity and specificity also improved when using the AI system (89.18% vs. 71.33%; p < 0.001, 96.68% vs. 92.16%; p < 0.001, respectively). Additionally, the classification accuracy rate improved with the aid of AI (86.40% vs. 75.45%; p < 0.001). Overall, the AI system could be used as an assistive diagnostic tool for both proficient and inexperienced colposcopists in cervical cancer screenings to estimate the impression and location of pathologic lesions. Further utilization of this system could help inexperienced colposcopists confirm where to perform a biopsy to diagnose high-grade lesions. MDPI 2023-06-13 /pmc/articles/PMC10298986/ /pubmed/37373717 http://dx.doi.org/10.3390/jcm12124024 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Kim, Seongmin
An, Hyonggin
Cho, Hyun-Woong
Min, Kyung-Jin
Hong, Jin-Hwa
Lee, Sanghoon
Song, Jae-Yun
Lee, Jae-Kwan
Lee, Nak-Woo
Pivotal Clinical Study to Evaluate the Efficacy and Safety of Assistive Artificial Intelligence-Based Software for Cervical Cancer Diagnosis
title Pivotal Clinical Study to Evaluate the Efficacy and Safety of Assistive Artificial Intelligence-Based Software for Cervical Cancer Diagnosis
title_full Pivotal Clinical Study to Evaluate the Efficacy and Safety of Assistive Artificial Intelligence-Based Software for Cervical Cancer Diagnosis
title_fullStr Pivotal Clinical Study to Evaluate the Efficacy and Safety of Assistive Artificial Intelligence-Based Software for Cervical Cancer Diagnosis
title_full_unstemmed Pivotal Clinical Study to Evaluate the Efficacy and Safety of Assistive Artificial Intelligence-Based Software for Cervical Cancer Diagnosis
title_short Pivotal Clinical Study to Evaluate the Efficacy and Safety of Assistive Artificial Intelligence-Based Software for Cervical Cancer Diagnosis
title_sort pivotal clinical study to evaluate the efficacy and safety of assistive artificial intelligence-based software for cervical cancer diagnosis
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10298986/
https://www.ncbi.nlm.nih.gov/pubmed/37373717
http://dx.doi.org/10.3390/jcm12124024
work_keys_str_mv AT kimseongmin pivotalclinicalstudytoevaluatetheefficacyandsafetyofassistiveartificialintelligencebasedsoftwareforcervicalcancerdiagnosis
AT anhyonggin pivotalclinicalstudytoevaluatetheefficacyandsafetyofassistiveartificialintelligencebasedsoftwareforcervicalcancerdiagnosis
AT chohyunwoong pivotalclinicalstudytoevaluatetheefficacyandsafetyofassistiveartificialintelligencebasedsoftwareforcervicalcancerdiagnosis
AT minkyungjin pivotalclinicalstudytoevaluatetheefficacyandsafetyofassistiveartificialintelligencebasedsoftwareforcervicalcancerdiagnosis
AT hongjinhwa pivotalclinicalstudytoevaluatetheefficacyandsafetyofassistiveartificialintelligencebasedsoftwareforcervicalcancerdiagnosis
AT leesanghoon pivotalclinicalstudytoevaluatetheefficacyandsafetyofassistiveartificialintelligencebasedsoftwareforcervicalcancerdiagnosis
AT songjaeyun pivotalclinicalstudytoevaluatetheefficacyandsafetyofassistiveartificialintelligencebasedsoftwareforcervicalcancerdiagnosis
AT leejaekwan pivotalclinicalstudytoevaluatetheefficacyandsafetyofassistiveartificialintelligencebasedsoftwareforcervicalcancerdiagnosis
AT leenakwoo pivotalclinicalstudytoevaluatetheefficacyandsafetyofassistiveartificialintelligencebasedsoftwareforcervicalcancerdiagnosis