Cargando…
Improved diagnostic performance of plain radiography for cervical ossification of the posterior longitudinal ligament using deep learning
BACKGROUND: A high false-negative rate has been reported for the diagnosis of ossification of the posterior longitudinal ligament (OPLL) using plain radiography. We investigated whether deep learning (DL) can improve the diagnostic performance of radiologists for cervical OPLL using plain radiograph...
Autores principales: | , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9045646/ https://www.ncbi.nlm.nih.gov/pubmed/35476649 http://dx.doi.org/10.1371/journal.pone.0267643 |
_version_ | 1784695360845774848 |
---|---|
author | Chae, Hee-Dong Hong, Sung Hwan Yeoh, Hyun Jung Kang, Yeo Ryang Lee, Su Min Kim, Minyoung Koh, Seok Young Lee, Yongeun Park, Moo Sung Choi, Ja-Young Yoo, Hye Jin |
author_facet | Chae, Hee-Dong Hong, Sung Hwan Yeoh, Hyun Jung Kang, Yeo Ryang Lee, Su Min Kim, Minyoung Koh, Seok Young Lee, Yongeun Park, Moo Sung Choi, Ja-Young Yoo, Hye Jin |
author_sort | Chae, Hee-Dong |
collection | PubMed |
description | BACKGROUND: A high false-negative rate has been reported for the diagnosis of ossification of the posterior longitudinal ligament (OPLL) using plain radiography. We investigated whether deep learning (DL) can improve the diagnostic performance of radiologists for cervical OPLL using plain radiographs. MATERIALS AND METHODS: The training set consisted of 915 radiographs from 207 patients diagnosed with OPLL. For the test set, we used 200 lateral cervical radiographs from 100 patients with cervical OPLL and 100 patients without OPLL. An observer performance study was conducted over two reading sessions. In the first session, we compared the diagnostic performance of the DL-model and the six observers. The diagnostic performance was evaluated using the area under the receiver operating characteristic curve (AUC) at the vertebra and patient level. The sensitivity and specificity of the DL model and average observers were calculated in per-patient analysis. Subgroup analysis was performed according to the morphologic classification of OPLL. In the second session, observers evaluated the radiographs by referring to the results of the DL-model. RESULTS: In the vertebra-level analysis, the DL-model showed an AUC of 0.854, which was higher than the average AUC of observers (0.826), but the difference was not significant (p = 0.292). In the patient-level analysis, the performance of the DL-model had an AUC of 0.851, and the average AUC of observers was 0.841 (p = 0.739). The patient-level sensitivity and specificity were 91% and 69% in the DL model, and 83% and 68% for the average observers, respectively. Both the DL-model and observers showed decreases in overall performance in the segmental and circumscribed types. With knowledge of the results of the DL-model, the average AUC of observers increased to 0.893 (p = 0.001) at the vertebra level and 0.911 (p < 0.001) at the patient level. In the subgroup analysis, the improvement was largest in segmental-type (AUC difference 0.087; p = 0.002). CONCLUSIONS: The DL-based OPLL detection model can significantly improve the diagnostic performance of radiologists on cervical radiographs. |
format | Online Article Text |
id | pubmed-9045646 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-90456462022-04-28 Improved diagnostic performance of plain radiography for cervical ossification of the posterior longitudinal ligament using deep learning Chae, Hee-Dong Hong, Sung Hwan Yeoh, Hyun Jung Kang, Yeo Ryang Lee, Su Min Kim, Minyoung Koh, Seok Young Lee, Yongeun Park, Moo Sung Choi, Ja-Young Yoo, Hye Jin PLoS One Research Article BACKGROUND: A high false-negative rate has been reported for the diagnosis of ossification of the posterior longitudinal ligament (OPLL) using plain radiography. We investigated whether deep learning (DL) can improve the diagnostic performance of radiologists for cervical OPLL using plain radiographs. MATERIALS AND METHODS: The training set consisted of 915 radiographs from 207 patients diagnosed with OPLL. For the test set, we used 200 lateral cervical radiographs from 100 patients with cervical OPLL and 100 patients without OPLL. An observer performance study was conducted over two reading sessions. In the first session, we compared the diagnostic performance of the DL-model and the six observers. The diagnostic performance was evaluated using the area under the receiver operating characteristic curve (AUC) at the vertebra and patient level. The sensitivity and specificity of the DL model and average observers were calculated in per-patient analysis. Subgroup analysis was performed according to the morphologic classification of OPLL. In the second session, observers evaluated the radiographs by referring to the results of the DL-model. RESULTS: In the vertebra-level analysis, the DL-model showed an AUC of 0.854, which was higher than the average AUC of observers (0.826), but the difference was not significant (p = 0.292). In the patient-level analysis, the performance of the DL-model had an AUC of 0.851, and the average AUC of observers was 0.841 (p = 0.739). The patient-level sensitivity and specificity were 91% and 69% in the DL model, and 83% and 68% for the average observers, respectively. Both the DL-model and observers showed decreases in overall performance in the segmental and circumscribed types. With knowledge of the results of the DL-model, the average AUC of observers increased to 0.893 (p = 0.001) at the vertebra level and 0.911 (p < 0.001) at the patient level. In the subgroup analysis, the improvement was largest in segmental-type (AUC difference 0.087; p = 0.002). CONCLUSIONS: The DL-based OPLL detection model can significantly improve the diagnostic performance of radiologists on cervical radiographs. Public Library of Science 2022-04-27 /pmc/articles/PMC9045646/ /pubmed/35476649 http://dx.doi.org/10.1371/journal.pone.0267643 Text en © 2022 Chae et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Chae, Hee-Dong Hong, Sung Hwan Yeoh, Hyun Jung Kang, Yeo Ryang Lee, Su Min Kim, Minyoung Koh, Seok Young Lee, Yongeun Park, Moo Sung Choi, Ja-Young Yoo, Hye Jin Improved diagnostic performance of plain radiography for cervical ossification of the posterior longitudinal ligament using deep learning |
title | Improved diagnostic performance of plain radiography for cervical ossification of the posterior longitudinal ligament using deep learning |
title_full | Improved diagnostic performance of plain radiography for cervical ossification of the posterior longitudinal ligament using deep learning |
title_fullStr | Improved diagnostic performance of plain radiography for cervical ossification of the posterior longitudinal ligament using deep learning |
title_full_unstemmed | Improved diagnostic performance of plain radiography for cervical ossification of the posterior longitudinal ligament using deep learning |
title_short | Improved diagnostic performance of plain radiography for cervical ossification of the posterior longitudinal ligament using deep learning |
title_sort | improved diagnostic performance of plain radiography for cervical ossification of the posterior longitudinal ligament using deep learning |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9045646/ https://www.ncbi.nlm.nih.gov/pubmed/35476649 http://dx.doi.org/10.1371/journal.pone.0267643 |
work_keys_str_mv | AT chaeheedong improveddiagnosticperformanceofplainradiographyforcervicalossificationoftheposteriorlongitudinalligamentusingdeeplearning AT hongsunghwan improveddiagnosticperformanceofplainradiographyforcervicalossificationoftheposteriorlongitudinalligamentusingdeeplearning AT yeohhyunjung improveddiagnosticperformanceofplainradiographyforcervicalossificationoftheposteriorlongitudinalligamentusingdeeplearning AT kangyeoryang improveddiagnosticperformanceofplainradiographyforcervicalossificationoftheposteriorlongitudinalligamentusingdeeplearning AT leesumin improveddiagnosticperformanceofplainradiographyforcervicalossificationoftheposteriorlongitudinalligamentusingdeeplearning AT kimminyoung improveddiagnosticperformanceofplainradiographyforcervicalossificationoftheposteriorlongitudinalligamentusingdeeplearning AT kohseokyoung improveddiagnosticperformanceofplainradiographyforcervicalossificationoftheposteriorlongitudinalligamentusingdeeplearning AT leeyongeun improveddiagnosticperformanceofplainradiographyforcervicalossificationoftheposteriorlongitudinalligamentusingdeeplearning AT parkmoosung improveddiagnosticperformanceofplainradiographyforcervicalossificationoftheposteriorlongitudinalligamentusingdeeplearning AT choijayoung improveddiagnosticperformanceofplainradiographyforcervicalossificationoftheposteriorlongitudinalligamentusingdeeplearning AT yoohyejin improveddiagnosticperformanceofplainradiographyforcervicalossificationoftheposteriorlongitudinalligamentusingdeeplearning |