Cargando…

A Framework for Modeling and Interpreting Patient Subgroups Applied to Hospital Readmission: Visual Analytical Approach

BACKGROUND: A primary goal of precision medicine is to identify patient subgroups and infer their underlying disease processes with the aim of designing targeted interventions. Although several studies have identified patient subgroups, there is a considerable gap between the identification of patie...

Descripción completa

Detalles Bibliográficos
Autores principales: Bhavnani, Suresh K, Zhang, Weibin, Visweswaran, Shyam, Raji, Mukaila, Kuo, Yong-Fang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9773032/
https://www.ncbi.nlm.nih.gov/pubmed/35537203
http://dx.doi.org/10.2196/37239
_version_ 1784855111308148736
author Bhavnani, Suresh K
Zhang, Weibin
Visweswaran, Shyam
Raji, Mukaila
Kuo, Yong-Fang
author_facet Bhavnani, Suresh K
Zhang, Weibin
Visweswaran, Shyam
Raji, Mukaila
Kuo, Yong-Fang
author_sort Bhavnani, Suresh K
collection PubMed
description BACKGROUND: A primary goal of precision medicine is to identify patient subgroups and infer their underlying disease processes with the aim of designing targeted interventions. Although several studies have identified patient subgroups, there is a considerable gap between the identification of patient subgroups and their modeling and interpretation for clinical applications. OBJECTIVE: This study aimed to develop and evaluate a novel analytical framework for modeling and interpreting patient subgroups (MIPS) using a 3-step modeling approach: visual analytical modeling to automatically identify patient subgroups and their co-occurring comorbidities and determine their statistical significance and clinical interpretability; classification modeling to classify patients into subgroups and measure its accuracy; and prediction modeling to predict a patient’s risk of an adverse outcome and compare its accuracy with and without patient subgroup information. METHODS: The MIPS framework was developed using bipartite networks to identify patient subgroups based on frequently co-occurring high-risk comorbidities, multinomial logistic regression to classify patients into subgroups, and hierarchical logistic regression to predict the risk of an adverse outcome using subgroup membership compared with standard logistic regression without subgroup membership. The MIPS framework was evaluated for 3 hospital readmission conditions: chronic obstructive pulmonary disease (COPD), congestive heart failure (CHF), and total hip arthroplasty/total knee arthroplasty (THA/TKA) (COPD: n=29,016; CHF: n=51,550; THA/TKA: n=16,498). For each condition, we extracted cases defined as patients readmitted within 30 days of hospital discharge. Controls were defined as patients not readmitted within 90 days of discharge, matched by age, sex, race, and Medicaid eligibility. RESULTS: In each condition, the visual analytical model identified patient subgroups that were statistically significant (Q=0.17, 0.17, 0.31; P<.001, <.001, <.05), significantly replicated (Rand Index=0.92, 0.94, 0.89; P<.001, <.001, <.01), and clinically meaningful to clinicians. In each condition, the classification model had high accuracy in classifying patients into subgroups (mean accuracy=99.6%, 99.34%, 99.86%). In 2 conditions (COPD and THA/TKA), the hierarchical prediction model had a small but statistically significant improvement in discriminating between readmitted and not readmitted patients as measured by net reclassification improvement (0.059, 0.11) but not as measured by the C-statistic or integrated discrimination improvement. CONCLUSIONS: Although the visual analytical models identified statistically and clinically significant patient subgroups, the results pinpoint the need to analyze subgroups at different levels of granularity for improving the interpretability of intra- and intercluster associations. The high accuracy of the classification models reflects the strong separation of patient subgroups, despite the size and density of the data sets. Finally, the small improvement in predictive accuracy suggests that comorbidities alone were not strong predictors of hospital readmission, and the need for more sophisticated subgroup modeling methods. Such advances could improve the interpretability and predictive accuracy of patient subgroup models for reducing the risk of hospital readmission, and beyond.
format Online
Article
Text
id pubmed-9773032
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-97730322022-12-23 A Framework for Modeling and Interpreting Patient Subgroups Applied to Hospital Readmission: Visual Analytical Approach Bhavnani, Suresh K Zhang, Weibin Visweswaran, Shyam Raji, Mukaila Kuo, Yong-Fang JMIR Med Inform Original Paper BACKGROUND: A primary goal of precision medicine is to identify patient subgroups and infer their underlying disease processes with the aim of designing targeted interventions. Although several studies have identified patient subgroups, there is a considerable gap between the identification of patient subgroups and their modeling and interpretation for clinical applications. OBJECTIVE: This study aimed to develop and evaluate a novel analytical framework for modeling and interpreting patient subgroups (MIPS) using a 3-step modeling approach: visual analytical modeling to automatically identify patient subgroups and their co-occurring comorbidities and determine their statistical significance and clinical interpretability; classification modeling to classify patients into subgroups and measure its accuracy; and prediction modeling to predict a patient’s risk of an adverse outcome and compare its accuracy with and without patient subgroup information. METHODS: The MIPS framework was developed using bipartite networks to identify patient subgroups based on frequently co-occurring high-risk comorbidities, multinomial logistic regression to classify patients into subgroups, and hierarchical logistic regression to predict the risk of an adverse outcome using subgroup membership compared with standard logistic regression without subgroup membership. The MIPS framework was evaluated for 3 hospital readmission conditions: chronic obstructive pulmonary disease (COPD), congestive heart failure (CHF), and total hip arthroplasty/total knee arthroplasty (THA/TKA) (COPD: n=29,016; CHF: n=51,550; THA/TKA: n=16,498). For each condition, we extracted cases defined as patients readmitted within 30 days of hospital discharge. Controls were defined as patients not readmitted within 90 days of discharge, matched by age, sex, race, and Medicaid eligibility. RESULTS: In each condition, the visual analytical model identified patient subgroups that were statistically significant (Q=0.17, 0.17, 0.31; P<.001, <.001, <.05), significantly replicated (Rand Index=0.92, 0.94, 0.89; P<.001, <.001, <.01), and clinically meaningful to clinicians. In each condition, the classification model had high accuracy in classifying patients into subgroups (mean accuracy=99.6%, 99.34%, 99.86%). In 2 conditions (COPD and THA/TKA), the hierarchical prediction model had a small but statistically significant improvement in discriminating between readmitted and not readmitted patients as measured by net reclassification improvement (0.059, 0.11) but not as measured by the C-statistic or integrated discrimination improvement. CONCLUSIONS: Although the visual analytical models identified statistically and clinically significant patient subgroups, the results pinpoint the need to analyze subgroups at different levels of granularity for improving the interpretability of intra- and intercluster associations. The high accuracy of the classification models reflects the strong separation of patient subgroups, despite the size and density of the data sets. Finally, the small improvement in predictive accuracy suggests that comorbidities alone were not strong predictors of hospital readmission, and the need for more sophisticated subgroup modeling methods. Such advances could improve the interpretability and predictive accuracy of patient subgroup models for reducing the risk of hospital readmission, and beyond. JMIR Publications 2022-12-07 /pmc/articles/PMC9773032/ /pubmed/35537203 http://dx.doi.org/10.2196/37239 Text en ©Suresh K Bhavnani, Weibin Zhang, Shyam Visweswaran, Mukaila Raji, Yong-Fang Kuo. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 07.12.2022. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Bhavnani, Suresh K
Zhang, Weibin
Visweswaran, Shyam
Raji, Mukaila
Kuo, Yong-Fang
A Framework for Modeling and Interpreting Patient Subgroups Applied to Hospital Readmission: Visual Analytical Approach
title A Framework for Modeling and Interpreting Patient Subgroups Applied to Hospital Readmission: Visual Analytical Approach
title_full A Framework for Modeling and Interpreting Patient Subgroups Applied to Hospital Readmission: Visual Analytical Approach
title_fullStr A Framework for Modeling and Interpreting Patient Subgroups Applied to Hospital Readmission: Visual Analytical Approach
title_full_unstemmed A Framework for Modeling and Interpreting Patient Subgroups Applied to Hospital Readmission: Visual Analytical Approach
title_short A Framework for Modeling and Interpreting Patient Subgroups Applied to Hospital Readmission: Visual Analytical Approach
title_sort framework for modeling and interpreting patient subgroups applied to hospital readmission: visual analytical approach
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9773032/
https://www.ncbi.nlm.nih.gov/pubmed/35537203
http://dx.doi.org/10.2196/37239
work_keys_str_mv AT bhavnanisureshk aframeworkformodelingandinterpretingpatientsubgroupsappliedtohospitalreadmissionvisualanalyticalapproach
AT zhangweibin aframeworkformodelingandinterpretingpatientsubgroupsappliedtohospitalreadmissionvisualanalyticalapproach
AT visweswaranshyam aframeworkformodelingandinterpretingpatientsubgroupsappliedtohospitalreadmissionvisualanalyticalapproach
AT rajimukaila aframeworkformodelingandinterpretingpatientsubgroupsappliedtohospitalreadmissionvisualanalyticalapproach
AT kuoyongfang aframeworkformodelingandinterpretingpatientsubgroupsappliedtohospitalreadmissionvisualanalyticalapproach
AT bhavnanisureshk frameworkformodelingandinterpretingpatientsubgroupsappliedtohospitalreadmissionvisualanalyticalapproach
AT zhangweibin frameworkformodelingandinterpretingpatientsubgroupsappliedtohospitalreadmissionvisualanalyticalapproach
AT visweswaranshyam frameworkformodelingandinterpretingpatientsubgroupsappliedtohospitalreadmissionvisualanalyticalapproach
AT rajimukaila frameworkformodelingandinterpretingpatientsubgroupsappliedtohospitalreadmissionvisualanalyticalapproach
AT kuoyongfang frameworkformodelingandinterpretingpatientsubgroupsappliedtohospitalreadmissionvisualanalyticalapproach