Cargando…
Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation
BACKGROUND: Cognitive behavioral therapy–based interventions are effective in reducing prenatal stress, which can have severe adverse health effects on mothers and newborns if unaddressed. Predicting next-day physiological or perceived stress can help to inform and enable pre-emptive interventions f...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9382551/ https://www.ncbi.nlm.nih.gov/pubmed/35917157 http://dx.doi.org/10.2196/33850 |
_version_ | 1784769307416199168 |
---|---|
author | Ng, Ada Wei, Boyang Jain, Jayalakshmi Ward, Erin A Tandon, S Darius Moskowitz, Judith T Krogh-Jespersen, Sheila Wakschlag, Lauren S Alshurafa, Nabil |
author_facet | Ng, Ada Wei, Boyang Jain, Jayalakshmi Ward, Erin A Tandon, S Darius Moskowitz, Judith T Krogh-Jespersen, Sheila Wakschlag, Lauren S Alshurafa, Nabil |
author_sort | Ng, Ada |
collection | PubMed |
description | BACKGROUND: Cognitive behavioral therapy–based interventions are effective in reducing prenatal stress, which can have severe adverse health effects on mothers and newborns if unaddressed. Predicting next-day physiological or perceived stress can help to inform and enable pre-emptive interventions for a likely physiologically and perceptibly stressful day. Machine learning models are useful tools that can be developed to predict next-day physiological and perceived stress by using data collected from the previous day. Such models can improve our understanding of the specific factors that predict physiological and perceived stress and allow researchers to develop systems that collect selected features for assessment in clinical trials to minimize the burden of data collection. OBJECTIVE: The aim of this study was to build and evaluate a machine-learned model that predicts next-day physiological and perceived stress by using sensor-based, ecological momentary assessment (EMA)–based, and intervention-based features and to explain the prediction results. METHODS: We enrolled pregnant women into a prospective proof-of-concept study and collected electrocardiography, EMA, and cognitive behavioral therapy intervention data over 12 weeks. We used the data to train and evaluate 6 machine learning models to predict next-day physiological and perceived stress. After selecting the best performing model, Shapley Additive Explanations were used to identify the feature importance and explainability of each feature. RESULTS: A total of 16 pregnant women enrolled in the study. Overall, 4157.18 hours of data were collected, and participants answered 2838 EMAs. After applying feature selection, 8 and 10 features were found to positively predict next-day physiological and perceived stress, respectively. A random forest classifier performed the best in predicting next-day physiological stress (F1 score of 0.84) and next-day perceived stress (F1 score of 0.74) by using all features. Although any subset of sensor-based, EMA-based, or intervention-based features could reliably predict next-day physiological stress, EMA-based features were necessary to predict next-day perceived stress. The analysis of explainability metrics showed that the prolonged duration of physiological stress was highly predictive of next-day physiological stress and that physiological stress and perceived stress were temporally divergent. CONCLUSIONS: In this study, we were able to build interpretable machine learning models to predict next-day physiological and perceived stress, and we identified unique features that were highly predictive of next-day stress that can help to reduce the burden of data collection. |
format | Online Article Text |
id | pubmed-9382551 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-93825512022-08-18 Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation Ng, Ada Wei, Boyang Jain, Jayalakshmi Ward, Erin A Tandon, S Darius Moskowitz, Judith T Krogh-Jespersen, Sheila Wakschlag, Lauren S Alshurafa, Nabil JMIR Mhealth Uhealth Original Paper BACKGROUND: Cognitive behavioral therapy–based interventions are effective in reducing prenatal stress, which can have severe adverse health effects on mothers and newborns if unaddressed. Predicting next-day physiological or perceived stress can help to inform and enable pre-emptive interventions for a likely physiologically and perceptibly stressful day. Machine learning models are useful tools that can be developed to predict next-day physiological and perceived stress by using data collected from the previous day. Such models can improve our understanding of the specific factors that predict physiological and perceived stress and allow researchers to develop systems that collect selected features for assessment in clinical trials to minimize the burden of data collection. OBJECTIVE: The aim of this study was to build and evaluate a machine-learned model that predicts next-day physiological and perceived stress by using sensor-based, ecological momentary assessment (EMA)–based, and intervention-based features and to explain the prediction results. METHODS: We enrolled pregnant women into a prospective proof-of-concept study and collected electrocardiography, EMA, and cognitive behavioral therapy intervention data over 12 weeks. We used the data to train and evaluate 6 machine learning models to predict next-day physiological and perceived stress. After selecting the best performing model, Shapley Additive Explanations were used to identify the feature importance and explainability of each feature. RESULTS: A total of 16 pregnant women enrolled in the study. Overall, 4157.18 hours of data were collected, and participants answered 2838 EMAs. After applying feature selection, 8 and 10 features were found to positively predict next-day physiological and perceived stress, respectively. A random forest classifier performed the best in predicting next-day physiological stress (F1 score of 0.84) and next-day perceived stress (F1 score of 0.74) by using all features. Although any subset of sensor-based, EMA-based, or intervention-based features could reliably predict next-day physiological stress, EMA-based features were necessary to predict next-day perceived stress. The analysis of explainability metrics showed that the prolonged duration of physiological stress was highly predictive of next-day physiological stress and that physiological stress and perceived stress were temporally divergent. CONCLUSIONS: In this study, we were able to build interpretable machine learning models to predict next-day physiological and perceived stress, and we identified unique features that were highly predictive of next-day stress that can help to reduce the burden of data collection. JMIR Publications 2022-08-02 /pmc/articles/PMC9382551/ /pubmed/35917157 http://dx.doi.org/10.2196/33850 Text en ©Ada Ng, Boyang Wei, Jayalakshmi Jain, Erin A Ward, S Darius Tandon, Judith T Moskowitz, Sheila Krogh-Jespersen, Lauren S Wakschlag, Nabil Alshurafa. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 02.08.2022. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Ng, Ada Wei, Boyang Jain, Jayalakshmi Ward, Erin A Tandon, S Darius Moskowitz, Judith T Krogh-Jespersen, Sheila Wakschlag, Lauren S Alshurafa, Nabil Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation |
title | Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation |
title_full | Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation |
title_fullStr | Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation |
title_full_unstemmed | Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation |
title_short | Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation |
title_sort | predicting the next-day perceived and physiological stress of pregnant women by using machine learning and explainability: algorithm development and validation |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9382551/ https://www.ncbi.nlm.nih.gov/pubmed/35917157 http://dx.doi.org/10.2196/33850 |
work_keys_str_mv | AT ngada predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation AT weiboyang predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation AT jainjayalakshmi predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation AT warderina predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation AT tandonsdarius predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation AT moskowitzjuditht predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation AT kroghjespersensheila predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation AT wakschlaglaurens predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation AT alshurafanabil predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation |