Cargando…

Interpretable Deep-Learning Approaches for Osteoporosis Risk Screening and Individualized Feature Analysis Using Large Population-Based Data: Model Development and Performance Evaluation

BACKGROUND: Osteoporosis is one of the diseases that requires early screening and detection for its management. Common clinical tools and machine-learning (ML) models for screening osteoporosis have been developed, but they show limitations such as low accuracy. Moreover, these methods are confined...

Descripción completa

Detalles Bibliográficos
Autores principales: Suh, Bogyeong, Yu, Heejin, Kim, Hyeyeon, Lee, Sanghwa, Kong, Sunghye, Kim, Jin-Woo, Choi, Jongeun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9883743/
https://www.ncbi.nlm.nih.gov/pubmed/36482780
http://dx.doi.org/10.2196/40179
_version_ 1784879570534531072
author Suh, Bogyeong
Yu, Heejin
Kim, Hyeyeon
Lee, Sanghwa
Kong, Sunghye
Kim, Jin-Woo
Choi, Jongeun
author_facet Suh, Bogyeong
Yu, Heejin
Kim, Hyeyeon
Lee, Sanghwa
Kong, Sunghye
Kim, Jin-Woo
Choi, Jongeun
author_sort Suh, Bogyeong
collection PubMed
description BACKGROUND: Osteoporosis is one of the diseases that requires early screening and detection for its management. Common clinical tools and machine-learning (ML) models for screening osteoporosis have been developed, but they show limitations such as low accuracy. Moreover, these methods are confined to limited risk factors and lack individualized explanation. OBJECTIVE: The aim of this study was to develop an interpretable deep-learning (DL) model for osteoporosis risk screening with clinical features. Clinical interpretation with individual explanations of feature contributions is provided using an explainable artificial intelligence (XAI) technique. METHODS: We used two separate data sets: the National Health and Nutrition Examination Survey data sets from the United States (NHANES) and South Korea (KNHANES) with 8274 and 8680 respondents, respectively. The study population was classified according to the T-score of bone mineral density at the femoral neck or total femur. A DL model for osteoporosis diagnosis was trained on the data sets and significant risk factors were investigated with local interpretable model-agnostic explanations (LIME). The performance of the DL model was compared with that of ML models and conventional clinical tools. Additionally, contribution ranking of risk factors and individualized explanation of feature contribution were examined. RESULTS: Our DL model showed area under the curve (AUC) values of 0.851 (95% CI 0.844-0.858) and 0.922 (95% CI 0.916-0.928) for the femoral neck and total femur bone mineral density, respectively, using the NHANES data set. The corresponding AUC values for the KNHANES data set were 0.827 (95% CI 0.821-0.833) and 0.912 (95% CI 0.898-0.927), respectively. Through the LIME method, significant features were induced, and each feature’s integrated contribution and interpretation for individual risk were determined. CONCLUSIONS: The developed DL model significantly outperforms conventional ML models and clinical tools. Our XAI model produces high-ranked features along with the integrated contributions of each feature, which facilitates the interpretation of individual risk. In summary, our interpretable model for osteoporosis risk screening outperformed state-of-the-art methods.
format Online
Article
Text
id pubmed-9883743
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-98837432023-01-29 Interpretable Deep-Learning Approaches for Osteoporosis Risk Screening and Individualized Feature Analysis Using Large Population-Based Data: Model Development and Performance Evaluation Suh, Bogyeong Yu, Heejin Kim, Hyeyeon Lee, Sanghwa Kong, Sunghye Kim, Jin-Woo Choi, Jongeun J Med Internet Res Original Paper BACKGROUND: Osteoporosis is one of the diseases that requires early screening and detection for its management. Common clinical tools and machine-learning (ML) models for screening osteoporosis have been developed, but they show limitations such as low accuracy. Moreover, these methods are confined to limited risk factors and lack individualized explanation. OBJECTIVE: The aim of this study was to develop an interpretable deep-learning (DL) model for osteoporosis risk screening with clinical features. Clinical interpretation with individual explanations of feature contributions is provided using an explainable artificial intelligence (XAI) technique. METHODS: We used two separate data sets: the National Health and Nutrition Examination Survey data sets from the United States (NHANES) and South Korea (KNHANES) with 8274 and 8680 respondents, respectively. The study population was classified according to the T-score of bone mineral density at the femoral neck or total femur. A DL model for osteoporosis diagnosis was trained on the data sets and significant risk factors were investigated with local interpretable model-agnostic explanations (LIME). The performance of the DL model was compared with that of ML models and conventional clinical tools. Additionally, contribution ranking of risk factors and individualized explanation of feature contribution were examined. RESULTS: Our DL model showed area under the curve (AUC) values of 0.851 (95% CI 0.844-0.858) and 0.922 (95% CI 0.916-0.928) for the femoral neck and total femur bone mineral density, respectively, using the NHANES data set. The corresponding AUC values for the KNHANES data set were 0.827 (95% CI 0.821-0.833) and 0.912 (95% CI 0.898-0.927), respectively. Through the LIME method, significant features were induced, and each feature’s integrated contribution and interpretation for individual risk were determined. CONCLUSIONS: The developed DL model significantly outperforms conventional ML models and clinical tools. Our XAI model produces high-ranked features along with the integrated contributions of each feature, which facilitates the interpretation of individual risk. In summary, our interpretable model for osteoporosis risk screening outperformed state-of-the-art methods. JMIR Publications 2023-01-13 /pmc/articles/PMC9883743/ /pubmed/36482780 http://dx.doi.org/10.2196/40179 Text en ©Bogyeong Suh, Heejin Yu, Hyeyeon Kim, Sanghwa Lee, Sunghye Kong, Jin-Woo Kim, Jongeun Choi. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 13.01.2023. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Suh, Bogyeong
Yu, Heejin
Kim, Hyeyeon
Lee, Sanghwa
Kong, Sunghye
Kim, Jin-Woo
Choi, Jongeun
Interpretable Deep-Learning Approaches for Osteoporosis Risk Screening and Individualized Feature Analysis Using Large Population-Based Data: Model Development and Performance Evaluation
title Interpretable Deep-Learning Approaches for Osteoporosis Risk Screening and Individualized Feature Analysis Using Large Population-Based Data: Model Development and Performance Evaluation
title_full Interpretable Deep-Learning Approaches for Osteoporosis Risk Screening and Individualized Feature Analysis Using Large Population-Based Data: Model Development and Performance Evaluation
title_fullStr Interpretable Deep-Learning Approaches for Osteoporosis Risk Screening and Individualized Feature Analysis Using Large Population-Based Data: Model Development and Performance Evaluation
title_full_unstemmed Interpretable Deep-Learning Approaches for Osteoporosis Risk Screening and Individualized Feature Analysis Using Large Population-Based Data: Model Development and Performance Evaluation
title_short Interpretable Deep-Learning Approaches for Osteoporosis Risk Screening and Individualized Feature Analysis Using Large Population-Based Data: Model Development and Performance Evaluation
title_sort interpretable deep-learning approaches for osteoporosis risk screening and individualized feature analysis using large population-based data: model development and performance evaluation
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9883743/
https://www.ncbi.nlm.nih.gov/pubmed/36482780
http://dx.doi.org/10.2196/40179
work_keys_str_mv AT suhbogyeong interpretabledeeplearningapproachesforosteoporosisriskscreeningandindividualizedfeatureanalysisusinglargepopulationbaseddatamodeldevelopmentandperformanceevaluation
AT yuheejin interpretabledeeplearningapproachesforosteoporosisriskscreeningandindividualizedfeatureanalysisusinglargepopulationbaseddatamodeldevelopmentandperformanceevaluation
AT kimhyeyeon interpretabledeeplearningapproachesforosteoporosisriskscreeningandindividualizedfeatureanalysisusinglargepopulationbaseddatamodeldevelopmentandperformanceevaluation
AT leesanghwa interpretabledeeplearningapproachesforosteoporosisriskscreeningandindividualizedfeatureanalysisusinglargepopulationbaseddatamodeldevelopmentandperformanceevaluation
AT kongsunghye interpretabledeeplearningapproachesforosteoporosisriskscreeningandindividualizedfeatureanalysisusinglargepopulationbaseddatamodeldevelopmentandperformanceevaluation
AT kimjinwoo interpretabledeeplearningapproachesforosteoporosisriskscreeningandindividualizedfeatureanalysisusinglargepopulationbaseddatamodeldevelopmentandperformanceevaluation
AT choijongeun interpretabledeeplearningapproachesforosteoporosisriskscreeningandindividualizedfeatureanalysisusinglargepopulationbaseddatamodeldevelopmentandperformanceevaluation