Cargando…

Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation

BACKGROUND: Cognitive behavioral therapy–based interventions are effective in reducing prenatal stress, which can have severe adverse health effects on mothers and newborns if unaddressed. Predicting next-day physiological or perceived stress can help to inform and enable pre-emptive interventions f...

Descripción completa

Detalles Bibliográficos
Autores principales: Ng, Ada, Wei, Boyang, Jain, Jayalakshmi, Ward, Erin A, Tandon, S Darius, Moskowitz, Judith T, Krogh-Jespersen, Sheila, Wakschlag, Lauren S, Alshurafa, Nabil
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9382551/
https://www.ncbi.nlm.nih.gov/pubmed/35917157
http://dx.doi.org/10.2196/33850
_version_ 1784769307416199168
author Ng, Ada
Wei, Boyang
Jain, Jayalakshmi
Ward, Erin A
Tandon, S Darius
Moskowitz, Judith T
Krogh-Jespersen, Sheila
Wakschlag, Lauren S
Alshurafa, Nabil
author_facet Ng, Ada
Wei, Boyang
Jain, Jayalakshmi
Ward, Erin A
Tandon, S Darius
Moskowitz, Judith T
Krogh-Jespersen, Sheila
Wakschlag, Lauren S
Alshurafa, Nabil
author_sort Ng, Ada
collection PubMed
description BACKGROUND: Cognitive behavioral therapy–based interventions are effective in reducing prenatal stress, which can have severe adverse health effects on mothers and newborns if unaddressed. Predicting next-day physiological or perceived stress can help to inform and enable pre-emptive interventions for a likely physiologically and perceptibly stressful day. Machine learning models are useful tools that can be developed to predict next-day physiological and perceived stress by using data collected from the previous day. Such models can improve our understanding of the specific factors that predict physiological and perceived stress and allow researchers to develop systems that collect selected features for assessment in clinical trials to minimize the burden of data collection. OBJECTIVE: The aim of this study was to build and evaluate a machine-learned model that predicts next-day physiological and perceived stress by using sensor-based, ecological momentary assessment (EMA)–based, and intervention-based features and to explain the prediction results. METHODS: We enrolled pregnant women into a prospective proof-of-concept study and collected electrocardiography, EMA, and cognitive behavioral therapy intervention data over 12 weeks. We used the data to train and evaluate 6 machine learning models to predict next-day physiological and perceived stress. After selecting the best performing model, Shapley Additive Explanations were used to identify the feature importance and explainability of each feature. RESULTS: A total of 16 pregnant women enrolled in the study. Overall, 4157.18 hours of data were collected, and participants answered 2838 EMAs. After applying feature selection, 8 and 10 features were found to positively predict next-day physiological and perceived stress, respectively. A random forest classifier performed the best in predicting next-day physiological stress (F1 score of 0.84) and next-day perceived stress (F1 score of 0.74) by using all features. Although any subset of sensor-based, EMA-based, or intervention-based features could reliably predict next-day physiological stress, EMA-based features were necessary to predict next-day perceived stress. The analysis of explainability metrics showed that the prolonged duration of physiological stress was highly predictive of next-day physiological stress and that physiological stress and perceived stress were temporally divergent. CONCLUSIONS: In this study, we were able to build interpretable machine learning models to predict next-day physiological and perceived stress, and we identified unique features that were highly predictive of next-day stress that can help to reduce the burden of data collection.
format Online
Article
Text
id pubmed-9382551
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-93825512022-08-18 Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation Ng, Ada Wei, Boyang Jain, Jayalakshmi Ward, Erin A Tandon, S Darius Moskowitz, Judith T Krogh-Jespersen, Sheila Wakschlag, Lauren S Alshurafa, Nabil JMIR Mhealth Uhealth Original Paper BACKGROUND: Cognitive behavioral therapy–based interventions are effective in reducing prenatal stress, which can have severe adverse health effects on mothers and newborns if unaddressed. Predicting next-day physiological or perceived stress can help to inform and enable pre-emptive interventions for a likely physiologically and perceptibly stressful day. Machine learning models are useful tools that can be developed to predict next-day physiological and perceived stress by using data collected from the previous day. Such models can improve our understanding of the specific factors that predict physiological and perceived stress and allow researchers to develop systems that collect selected features for assessment in clinical trials to minimize the burden of data collection. OBJECTIVE: The aim of this study was to build and evaluate a machine-learned model that predicts next-day physiological and perceived stress by using sensor-based, ecological momentary assessment (EMA)–based, and intervention-based features and to explain the prediction results. METHODS: We enrolled pregnant women into a prospective proof-of-concept study and collected electrocardiography, EMA, and cognitive behavioral therapy intervention data over 12 weeks. We used the data to train and evaluate 6 machine learning models to predict next-day physiological and perceived stress. After selecting the best performing model, Shapley Additive Explanations were used to identify the feature importance and explainability of each feature. RESULTS: A total of 16 pregnant women enrolled in the study. Overall, 4157.18 hours of data were collected, and participants answered 2838 EMAs. After applying feature selection, 8 and 10 features were found to positively predict next-day physiological and perceived stress, respectively. A random forest classifier performed the best in predicting next-day physiological stress (F1 score of 0.84) and next-day perceived stress (F1 score of 0.74) by using all features. Although any subset of sensor-based, EMA-based, or intervention-based features could reliably predict next-day physiological stress, EMA-based features were necessary to predict next-day perceived stress. The analysis of explainability metrics showed that the prolonged duration of physiological stress was highly predictive of next-day physiological stress and that physiological stress and perceived stress were temporally divergent. CONCLUSIONS: In this study, we were able to build interpretable machine learning models to predict next-day physiological and perceived stress, and we identified unique features that were highly predictive of next-day stress that can help to reduce the burden of data collection. JMIR Publications 2022-08-02 /pmc/articles/PMC9382551/ /pubmed/35917157 http://dx.doi.org/10.2196/33850 Text en ©Ada Ng, Boyang Wei, Jayalakshmi Jain, Erin A Ward, S Darius Tandon, Judith T Moskowitz, Sheila Krogh-Jespersen, Lauren S Wakschlag, Nabil Alshurafa. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 02.08.2022. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Ng, Ada
Wei, Boyang
Jain, Jayalakshmi
Ward, Erin A
Tandon, S Darius
Moskowitz, Judith T
Krogh-Jespersen, Sheila
Wakschlag, Lauren S
Alshurafa, Nabil
Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation
title Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation
title_full Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation
title_fullStr Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation
title_full_unstemmed Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation
title_short Predicting the Next-Day Perceived and Physiological Stress of Pregnant Women by Using Machine Learning and Explainability: Algorithm Development and Validation
title_sort predicting the next-day perceived and physiological stress of pregnant women by using machine learning and explainability: algorithm development and validation
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9382551/
https://www.ncbi.nlm.nih.gov/pubmed/35917157
http://dx.doi.org/10.2196/33850
work_keys_str_mv AT ngada predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation
AT weiboyang predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation
AT jainjayalakshmi predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation
AT warderina predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation
AT tandonsdarius predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation
AT moskowitzjuditht predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation
AT kroghjespersensheila predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation
AT wakschlaglaurens predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation
AT alshurafanabil predictingthenextdayperceivedandphysiologicalstressofpregnantwomenbyusingmachinelearningandexplainabilityalgorithmdevelopmentandvalidation