Cargando…

Analyzing and Forecasting Pediatric Fever Clinic Visits in High Frequency Using Ensemble Time-Series Methods After the COVID-19 Pandemic in Hangzhou, China: Retrospective Study

BACKGROUND: The COVID-19 pandemic has significantly altered the global health and medical landscape. In response to the outbreak, Chinese hospitals have established 24-hour fever clinics to serve patients with COVID-19. The emergence of these clinics and the impact of successive epidemics have led t...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Wang, Zhu, Zhu, Zhao, Yonggen, Li, Zheming, Chen, Lingdong, Huang, Jian, Li, Jing, Yu, Gang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10551790/
https://www.ncbi.nlm.nih.gov/pubmed/37728972
http://dx.doi.org/10.2196/45846
_version_ 1785115844900028416
author Zhang, Wang
Zhu, Zhu
Zhao, Yonggen
Li, Zheming
Chen, Lingdong
Huang, Jian
Li, Jing
Yu, Gang
author_facet Zhang, Wang
Zhu, Zhu
Zhao, Yonggen
Li, Zheming
Chen, Lingdong
Huang, Jian
Li, Jing
Yu, Gang
author_sort Zhang, Wang
collection PubMed
description BACKGROUND: The COVID-19 pandemic has significantly altered the global health and medical landscape. In response to the outbreak, Chinese hospitals have established 24-hour fever clinics to serve patients with COVID-19. The emergence of these clinics and the impact of successive epidemics have led to a surge in visits, placing pressure on hospital resource allocation and scheduling. Therefore, accurate prediction of outpatient visits is essential for informed decision-making in hospital management. OBJECTIVE: Hourly visits to fever clinics can be characterized as a long-sequence time series in high frequency, which also exhibits distinct patterns due to the particularity of pediatric treatment behavior in an epidemic context. This study aimed to build models to forecast fever clinic visit with outstanding prediction accuracy and robust generalization in forecast horizons. In addition, this study hopes to provide a research paradigm for time-series forecasting problems, which involves an exploratory analysis revealing data patterns before model development. METHODS: An exploratory analysis, including graphical analysis, autocorrelation analysis, and seasonal-trend decomposition, was conducted to reveal the seasonality and structural patterns of the retrospective fever clinic visit data. The data were found to exhibit multiseasonality and nonlinearity. On the basis of these results, an ensemble of time-series analysis methods, including individual models and their combinations, was validated on the data set. Root mean square error and mean absolute error were used as accuracy metrics, with the cross-validation of rolling forecasting origin conducted across different forecast horizons. RESULTS: Hybrid models generally outperformed individual models across most forecast horizons. A novel model combination, the hybrid neural network autoregressive (NNAR)-seasonal and trend decomposition using Loess forecasting (STLF), was identified as the optimal model for our forecasting task, with the best performance in all accuracy metrics (root mean square error=20.1, mean absolute error=14.3) for the 15-days-ahead forecasts and an overall advantage for forecast horizons that were 1 to 30 days ahead. CONCLUSIONS: Although forecast accuracy tends to decline with an increasing forecast horizon, the hybrid NNAR-STLF model is applicable for short-, medium-, and long-term forecasts owing to its ability to fit multiseasonality (captured by the STLF component) and nonlinearity (captured by the NNAR component). The model identified in this study is also applicable to hospitals in other regions with similar epidemic outpatient configurations or forecasting tasks whose data conform to long-sequence time series in high frequency exhibiting multiseasonal and nonlinear patterns. However, as external variables and disruptive events were not accounted for, the model performance declined slightly following changes in the COVID-19 containment policy in China. Future work may seek to improve accuracy by incorporating external variables that characterize moving events or other factors as well as by adding data from different organizations to enhance algorithm generalization.
format Online
Article
Text
id pubmed-10551790
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-105517902023-10-06 Analyzing and Forecasting Pediatric Fever Clinic Visits in High Frequency Using Ensemble Time-Series Methods After the COVID-19 Pandemic in Hangzhou, China: Retrospective Study Zhang, Wang Zhu, Zhu Zhao, Yonggen Li, Zheming Chen, Lingdong Huang, Jian Li, Jing Yu, Gang JMIR Med Inform Original Paper BACKGROUND: The COVID-19 pandemic has significantly altered the global health and medical landscape. In response to the outbreak, Chinese hospitals have established 24-hour fever clinics to serve patients with COVID-19. The emergence of these clinics and the impact of successive epidemics have led to a surge in visits, placing pressure on hospital resource allocation and scheduling. Therefore, accurate prediction of outpatient visits is essential for informed decision-making in hospital management. OBJECTIVE: Hourly visits to fever clinics can be characterized as a long-sequence time series in high frequency, which also exhibits distinct patterns due to the particularity of pediatric treatment behavior in an epidemic context. This study aimed to build models to forecast fever clinic visit with outstanding prediction accuracy and robust generalization in forecast horizons. In addition, this study hopes to provide a research paradigm for time-series forecasting problems, which involves an exploratory analysis revealing data patterns before model development. METHODS: An exploratory analysis, including graphical analysis, autocorrelation analysis, and seasonal-trend decomposition, was conducted to reveal the seasonality and structural patterns of the retrospective fever clinic visit data. The data were found to exhibit multiseasonality and nonlinearity. On the basis of these results, an ensemble of time-series analysis methods, including individual models and their combinations, was validated on the data set. Root mean square error and mean absolute error were used as accuracy metrics, with the cross-validation of rolling forecasting origin conducted across different forecast horizons. RESULTS: Hybrid models generally outperformed individual models across most forecast horizons. A novel model combination, the hybrid neural network autoregressive (NNAR)-seasonal and trend decomposition using Loess forecasting (STLF), was identified as the optimal model for our forecasting task, with the best performance in all accuracy metrics (root mean square error=20.1, mean absolute error=14.3) for the 15-days-ahead forecasts and an overall advantage for forecast horizons that were 1 to 30 days ahead. CONCLUSIONS: Although forecast accuracy tends to decline with an increasing forecast horizon, the hybrid NNAR-STLF model is applicable for short-, medium-, and long-term forecasts owing to its ability to fit multiseasonality (captured by the STLF component) and nonlinearity (captured by the NNAR component). The model identified in this study is also applicable to hospitals in other regions with similar epidemic outpatient configurations or forecasting tasks whose data conform to long-sequence time series in high frequency exhibiting multiseasonal and nonlinear patterns. However, as external variables and disruptive events were not accounted for, the model performance declined slightly following changes in the COVID-19 containment policy in China. Future work may seek to improve accuracy by incorporating external variables that characterize moving events or other factors as well as by adding data from different organizations to enhance algorithm generalization. JMIR Publications 2023-09-20 /pmc/articles/PMC10551790/ /pubmed/37728972 http://dx.doi.org/10.2196/45846 Text en ©Wang Zhang, Zhu Zhu, Yonggen Zhao, Zheming Li, Lingdong Chen, Jian Huang, Jing Li, Gang Yu. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 20.09.2023. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Zhang, Wang
Zhu, Zhu
Zhao, Yonggen
Li, Zheming
Chen, Lingdong
Huang, Jian
Li, Jing
Yu, Gang
Analyzing and Forecasting Pediatric Fever Clinic Visits in High Frequency Using Ensemble Time-Series Methods After the COVID-19 Pandemic in Hangzhou, China: Retrospective Study
title Analyzing and Forecasting Pediatric Fever Clinic Visits in High Frequency Using Ensemble Time-Series Methods After the COVID-19 Pandemic in Hangzhou, China: Retrospective Study
title_full Analyzing and Forecasting Pediatric Fever Clinic Visits in High Frequency Using Ensemble Time-Series Methods After the COVID-19 Pandemic in Hangzhou, China: Retrospective Study
title_fullStr Analyzing and Forecasting Pediatric Fever Clinic Visits in High Frequency Using Ensemble Time-Series Methods After the COVID-19 Pandemic in Hangzhou, China: Retrospective Study
title_full_unstemmed Analyzing and Forecasting Pediatric Fever Clinic Visits in High Frequency Using Ensemble Time-Series Methods After the COVID-19 Pandemic in Hangzhou, China: Retrospective Study
title_short Analyzing and Forecasting Pediatric Fever Clinic Visits in High Frequency Using Ensemble Time-Series Methods After the COVID-19 Pandemic in Hangzhou, China: Retrospective Study
title_sort analyzing and forecasting pediatric fever clinic visits in high frequency using ensemble time-series methods after the covid-19 pandemic in hangzhou, china: retrospective study
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10551790/
https://www.ncbi.nlm.nih.gov/pubmed/37728972
http://dx.doi.org/10.2196/45846
work_keys_str_mv AT zhangwang analyzingandforecastingpediatricfeverclinicvisitsinhighfrequencyusingensembletimeseriesmethodsafterthecovid19pandemicinhangzhouchinaretrospectivestudy
AT zhuzhu analyzingandforecastingpediatricfeverclinicvisitsinhighfrequencyusingensembletimeseriesmethodsafterthecovid19pandemicinhangzhouchinaretrospectivestudy
AT zhaoyonggen analyzingandforecastingpediatricfeverclinicvisitsinhighfrequencyusingensembletimeseriesmethodsafterthecovid19pandemicinhangzhouchinaretrospectivestudy
AT lizheming analyzingandforecastingpediatricfeverclinicvisitsinhighfrequencyusingensembletimeseriesmethodsafterthecovid19pandemicinhangzhouchinaretrospectivestudy
AT chenlingdong analyzingandforecastingpediatricfeverclinicvisitsinhighfrequencyusingensembletimeseriesmethodsafterthecovid19pandemicinhangzhouchinaretrospectivestudy
AT huangjian analyzingandforecastingpediatricfeverclinicvisitsinhighfrequencyusingensembletimeseriesmethodsafterthecovid19pandemicinhangzhouchinaretrospectivestudy
AT lijing analyzingandforecastingpediatricfeverclinicvisitsinhighfrequencyusingensembletimeseriesmethodsafterthecovid19pandemicinhangzhouchinaretrospectivestudy
AT yugang analyzingandforecastingpediatricfeverclinicvisitsinhighfrequencyusingensembletimeseriesmethodsafterthecovid19pandemicinhangzhouchinaretrospectivestudy