Cargando…
Comparison of methods for predicting COVID-19-related death in the general population using the OpenSAFELY platform
BACKGROUND: Obtaining accurate estimates of the risk of COVID-19-related death in the general population is challenging in the context of changing levels of circulating infection. METHODS: We propose a modelling approach to predict 28-day COVID-19-related death which explicitly accounts for COVID-19...
Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8865947/ https://www.ncbi.nlm.nih.gov/pubmed/35197114 http://dx.doi.org/10.1186/s41512-022-00120-2 |
_version_ | 1784655728223453184 |
---|---|
author | Williamson, Elizabeth J. Tazare, John Bhaskaran, Krishnan McDonald, Helen I. Walker, Alex J. Tomlinson, Laurie Wing, Kevin Bacon, Sebastian Bates, Chris Curtis, Helen J. Forbes, Harriet J. Minassian, Caroline Morton, Caroline E. Nightingale, Emily Mehrkar, Amir Evans, David Nicholson, Brian D. Leon, David A. Inglesby, Peter MacKenna, Brian Davies, Nicholas G. DeVito, Nicholas J. Drysdale, Henry Cockburn, Jonathan Hulme, William J. Morley, Jessica Douglas, Ian Rentsch, Christopher T. Mathur, Rohini Wong, Angel Schultze, Anna Croker, Richard Parry, John Hester, Frank Harper, Sam Grieve, Richard Harrison, David A. Steyerberg, Ewout W. Eggo, Rosalind M. Diaz-Ordaz, Karla Keogh, Ruth Evans, Stephen J. W. Smeeth, Liam Goldacre, Ben |
author_facet | Williamson, Elizabeth J. Tazare, John Bhaskaran, Krishnan McDonald, Helen I. Walker, Alex J. Tomlinson, Laurie Wing, Kevin Bacon, Sebastian Bates, Chris Curtis, Helen J. Forbes, Harriet J. Minassian, Caroline Morton, Caroline E. Nightingale, Emily Mehrkar, Amir Evans, David Nicholson, Brian D. Leon, David A. Inglesby, Peter MacKenna, Brian Davies, Nicholas G. DeVito, Nicholas J. Drysdale, Henry Cockburn, Jonathan Hulme, William J. Morley, Jessica Douglas, Ian Rentsch, Christopher T. Mathur, Rohini Wong, Angel Schultze, Anna Croker, Richard Parry, John Hester, Frank Harper, Sam Grieve, Richard Harrison, David A. Steyerberg, Ewout W. Eggo, Rosalind M. Diaz-Ordaz, Karla Keogh, Ruth Evans, Stephen J. W. Smeeth, Liam Goldacre, Ben |
collection | PubMed |
description | BACKGROUND: Obtaining accurate estimates of the risk of COVID-19-related death in the general population is challenging in the context of changing levels of circulating infection. METHODS: We propose a modelling approach to predict 28-day COVID-19-related death which explicitly accounts for COVID-19 infection prevalence using a series of sub-studies from new landmark times incorporating time-updating proxy measures of COVID-19 infection prevalence. This was compared with an approach ignoring infection prevalence. The target population was adults registered at a general practice in England in March 2020. The outcome was 28-day COVID-19-related death. Predictors included demographic characteristics and comorbidities. Three proxies of local infection prevalence were used: model-based estimates, rate of COVID-19-related attendances in emergency care, and rate of suspected COVID-19 cases in primary care. We used data within the TPP SystmOne electronic health record system linked to Office for National Statistics mortality data, using the OpenSAFELY platform, working on behalf of NHS England. Prediction models were developed in case-cohort samples with a 100-day follow-up. Validation was undertaken in 28-day cohorts from the target population. We considered predictive performance (discrimination and calibration) in geographical and temporal subsets of data not used in developing the risk prediction models. Simple models were contrasted to models including a full range of predictors. RESULTS: Prediction models were developed on 11,972,947 individuals, of whom 7999 experienced COVID-19-related death. All models discriminated well between individuals who did and did not experience the outcome, including simple models adjusting only for basic demographics and number of comorbidities: C-statistics 0.92–0.94. However, absolute risk estimates were substantially miscalibrated when infection prevalence was not explicitly modelled. CONCLUSIONS: Our proposed models allow absolute risk estimation in the context of changing infection prevalence but predictive performance is sensitive to the proxy for infection prevalence. Simple models can provide excellent discrimination and may simplify implementation of risk prediction tools. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s41512-022-00120-2. |
format | Online Article Text |
id | pubmed-8865947 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-88659472022-02-24 Comparison of methods for predicting COVID-19-related death in the general population using the OpenSAFELY platform Williamson, Elizabeth J. Tazare, John Bhaskaran, Krishnan McDonald, Helen I. Walker, Alex J. Tomlinson, Laurie Wing, Kevin Bacon, Sebastian Bates, Chris Curtis, Helen J. Forbes, Harriet J. Minassian, Caroline Morton, Caroline E. Nightingale, Emily Mehrkar, Amir Evans, David Nicholson, Brian D. Leon, David A. Inglesby, Peter MacKenna, Brian Davies, Nicholas G. DeVito, Nicholas J. Drysdale, Henry Cockburn, Jonathan Hulme, William J. Morley, Jessica Douglas, Ian Rentsch, Christopher T. Mathur, Rohini Wong, Angel Schultze, Anna Croker, Richard Parry, John Hester, Frank Harper, Sam Grieve, Richard Harrison, David A. Steyerberg, Ewout W. Eggo, Rosalind M. Diaz-Ordaz, Karla Keogh, Ruth Evans, Stephen J. W. Smeeth, Liam Goldacre, Ben Diagn Progn Res Research BACKGROUND: Obtaining accurate estimates of the risk of COVID-19-related death in the general population is challenging in the context of changing levels of circulating infection. METHODS: We propose a modelling approach to predict 28-day COVID-19-related death which explicitly accounts for COVID-19 infection prevalence using a series of sub-studies from new landmark times incorporating time-updating proxy measures of COVID-19 infection prevalence. This was compared with an approach ignoring infection prevalence. The target population was adults registered at a general practice in England in March 2020. The outcome was 28-day COVID-19-related death. Predictors included demographic characteristics and comorbidities. Three proxies of local infection prevalence were used: model-based estimates, rate of COVID-19-related attendances in emergency care, and rate of suspected COVID-19 cases in primary care. We used data within the TPP SystmOne electronic health record system linked to Office for National Statistics mortality data, using the OpenSAFELY platform, working on behalf of NHS England. Prediction models were developed in case-cohort samples with a 100-day follow-up. Validation was undertaken in 28-day cohorts from the target population. We considered predictive performance (discrimination and calibration) in geographical and temporal subsets of data not used in developing the risk prediction models. Simple models were contrasted to models including a full range of predictors. RESULTS: Prediction models were developed on 11,972,947 individuals, of whom 7999 experienced COVID-19-related death. All models discriminated well between individuals who did and did not experience the outcome, including simple models adjusting only for basic demographics and number of comorbidities: C-statistics 0.92–0.94. However, absolute risk estimates were substantially miscalibrated when infection prevalence was not explicitly modelled. CONCLUSIONS: Our proposed models allow absolute risk estimation in the context of changing infection prevalence but predictive performance is sensitive to the proxy for infection prevalence. Simple models can provide excellent discrimination and may simplify implementation of risk prediction tools. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s41512-022-00120-2. BioMed Central 2022-02-24 /pmc/articles/PMC8865947/ /pubmed/35197114 http://dx.doi.org/10.1186/s41512-022-00120-2 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Research Williamson, Elizabeth J. Tazare, John Bhaskaran, Krishnan McDonald, Helen I. Walker, Alex J. Tomlinson, Laurie Wing, Kevin Bacon, Sebastian Bates, Chris Curtis, Helen J. Forbes, Harriet J. Minassian, Caroline Morton, Caroline E. Nightingale, Emily Mehrkar, Amir Evans, David Nicholson, Brian D. Leon, David A. Inglesby, Peter MacKenna, Brian Davies, Nicholas G. DeVito, Nicholas J. Drysdale, Henry Cockburn, Jonathan Hulme, William J. Morley, Jessica Douglas, Ian Rentsch, Christopher T. Mathur, Rohini Wong, Angel Schultze, Anna Croker, Richard Parry, John Hester, Frank Harper, Sam Grieve, Richard Harrison, David A. Steyerberg, Ewout W. Eggo, Rosalind M. Diaz-Ordaz, Karla Keogh, Ruth Evans, Stephen J. W. Smeeth, Liam Goldacre, Ben Comparison of methods for predicting COVID-19-related death in the general population using the OpenSAFELY platform |
title | Comparison of methods for predicting COVID-19-related death in the general population using the OpenSAFELY platform |
title_full | Comparison of methods for predicting COVID-19-related death in the general population using the OpenSAFELY platform |
title_fullStr | Comparison of methods for predicting COVID-19-related death in the general population using the OpenSAFELY platform |
title_full_unstemmed | Comparison of methods for predicting COVID-19-related death in the general population using the OpenSAFELY platform |
title_short | Comparison of methods for predicting COVID-19-related death in the general population using the OpenSAFELY platform |
title_sort | comparison of methods for predicting covid-19-related death in the general population using the opensafely platform |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8865947/ https://www.ncbi.nlm.nih.gov/pubmed/35197114 http://dx.doi.org/10.1186/s41512-022-00120-2 |
work_keys_str_mv | AT comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT williamsonelizabethj comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT tazarejohn comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT bhaskarankrishnan comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT mcdonaldheleni comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT walkeralexj comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT tomlinsonlaurie comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT wingkevin comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT baconsebastian comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT bateschris comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT curtishelenj comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT forbesharrietj comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT minassiancaroline comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT mortoncarolinee comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT nightingaleemily comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT mehrkaramir comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT evansdavid comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT nicholsonbriand comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT leondavida comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT inglesbypeter comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT mackennabrian comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT daviesnicholasg comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT devitonicholasj comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT drysdalehenry comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT cockburnjonathan comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT hulmewilliamj comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT morleyjessica comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT douglasian comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT rentschchristophert comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT mathurrohini comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT wongangel comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT schultzeanna comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT crokerrichard comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT parryjohn comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT hesterfrank comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT harpersam comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT grieverichard comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT harrisondavida comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT steyerbergewoutw comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT eggorosalindm comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT diazordazkarla comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT keoghruth comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT evansstephenjw comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT smeethliam comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform AT goldacreben comparisonofmethodsforpredictingcovid19relateddeathinthegeneralpopulationusingtheopensafelyplatform |