Cargando…
Prognosis research ideally should measure time-varying predictors at their intended moment of use
BACKGROUND: Prognosis research studies (e.g. those deriving prognostic models or examining potential predictors of outcome) often collect information on time-varying predictors after their intended moment of use, sometimes using a measurement method different to that which would be used. We aimed to...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2017
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6457137/ https://www.ncbi.nlm.nih.gov/pubmed/31093533 http://dx.doi.org/10.1186/s41512-016-0006-6 |
_version_ | 1783409862066044928 |
---|---|
author | Whittle, Rebecca Royle, Kara-Louise Jordan, Kelvin P. Riley, Richard D. Mallen, Christian D. Peat, George |
author_facet | Whittle, Rebecca Royle, Kara-Louise Jordan, Kelvin P. Riley, Richard D. Mallen, Christian D. Peat, George |
author_sort | Whittle, Rebecca |
collection | PubMed |
description | BACKGROUND: Prognosis research studies (e.g. those deriving prognostic models or examining potential predictors of outcome) often collect information on time-varying predictors after their intended moment of use, sometimes using a measurement method different to that which would be used. We aimed to illustrate how estimates of predictor-outcome associations and prognostic model performance obtained from such studies may differ to those at the earlier, intended moment of use. METHODS: We analysed data from two primary care cohorts of patients consulting for non-inflammatory musculoskeletal conditions: the Prognostic Research Study (PROG-RES: n = 296, aged >50 years) and the Primary care Osteoarthritis Screening Trial (POST: n = 756, >45 years). Both cohorts had collected comparable information on a potentially important time-varying predictor (current pain intensity: 0–10 numerical rating scale), other predictors (age, gender, practice) and outcome (patient-perceived non-recovery at 6 months). Using logistic regression models, we compared the direction and magnitude of predictor-outcome associations and model performance measures under two scenarios: (i) current pain intensity ascertained by the treating general practitioner in the consultation (the intended moment of use) and (ii) current pain intensity ascertained by a questionnaire mailed several days after the consultation. RESULTS: In both cohorts, the predictor-outcome association was substantially weaker for pain measured at the consultation (OR (95% CI): PROG-RES 1.06 (0.95, 1.18); POST 1.04 (0.96, 1.12)) than for pain measured in the questionnaire (PROG-RES 1.34 (1.20, 1.48); POST 1.26 (1.18, 1.34)). The c-statistic of the multivariable model was lower when pain was measured at the consultation (c-statistic (95% CI): PROG-RES 0.57 (0.51, 0.64); POST 0.66 (0.62, 0.70)) than when pain was measured in the questionnaire (PROG-RES 0.69 (0.63, 0.75); POST 0.72 (0.68, 0.76)), reflecting the lower OR for pain at the consultation. CONCLUSIONS: Prognostic research studies ideally should measure time-varying predictors at their intended moment of use and using the intended measurement method. Otherwise, they may produce substantially different estimates of predictor-outcome associations and model performance. Researchers should report when, how and where predictors were measured and identify any significant departures from their intended use that may limit the applicability of findings in practice. TRIAL REGISTRATION: The protocol for the PROG-RES cohort data collection and primary analysis has been published in an open-access journal (Mallen et al., BMC Musculoskelet Disord 7:84, 2006). The POST trial was registered (ISRCTN40721988; date of registration: 21 June 2011; date of enrolment of the first participant: 3 October 2011) and had a pre-specified protocol covering primary analysis. There was no published protocol for the current secondary analyses presented in this manuscript. |
format | Online Article Text |
id | pubmed-6457137 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2017 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-64571372019-05-15 Prognosis research ideally should measure time-varying predictors at their intended moment of use Whittle, Rebecca Royle, Kara-Louise Jordan, Kelvin P. Riley, Richard D. Mallen, Christian D. Peat, George Diagn Progn Res Research BACKGROUND: Prognosis research studies (e.g. those deriving prognostic models or examining potential predictors of outcome) often collect information on time-varying predictors after their intended moment of use, sometimes using a measurement method different to that which would be used. We aimed to illustrate how estimates of predictor-outcome associations and prognostic model performance obtained from such studies may differ to those at the earlier, intended moment of use. METHODS: We analysed data from two primary care cohorts of patients consulting for non-inflammatory musculoskeletal conditions: the Prognostic Research Study (PROG-RES: n = 296, aged >50 years) and the Primary care Osteoarthritis Screening Trial (POST: n = 756, >45 years). Both cohorts had collected comparable information on a potentially important time-varying predictor (current pain intensity: 0–10 numerical rating scale), other predictors (age, gender, practice) and outcome (patient-perceived non-recovery at 6 months). Using logistic regression models, we compared the direction and magnitude of predictor-outcome associations and model performance measures under two scenarios: (i) current pain intensity ascertained by the treating general practitioner in the consultation (the intended moment of use) and (ii) current pain intensity ascertained by a questionnaire mailed several days after the consultation. RESULTS: In both cohorts, the predictor-outcome association was substantially weaker for pain measured at the consultation (OR (95% CI): PROG-RES 1.06 (0.95, 1.18); POST 1.04 (0.96, 1.12)) than for pain measured in the questionnaire (PROG-RES 1.34 (1.20, 1.48); POST 1.26 (1.18, 1.34)). The c-statistic of the multivariable model was lower when pain was measured at the consultation (c-statistic (95% CI): PROG-RES 0.57 (0.51, 0.64); POST 0.66 (0.62, 0.70)) than when pain was measured in the questionnaire (PROG-RES 0.69 (0.63, 0.75); POST 0.72 (0.68, 0.76)), reflecting the lower OR for pain at the consultation. CONCLUSIONS: Prognostic research studies ideally should measure time-varying predictors at their intended moment of use and using the intended measurement method. Otherwise, they may produce substantially different estimates of predictor-outcome associations and model performance. Researchers should report when, how and where predictors were measured and identify any significant departures from their intended use that may limit the applicability of findings in practice. TRIAL REGISTRATION: The protocol for the PROG-RES cohort data collection and primary analysis has been published in an open-access journal (Mallen et al., BMC Musculoskelet Disord 7:84, 2006). The POST trial was registered (ISRCTN40721988; date of registration: 21 June 2011; date of enrolment of the first participant: 3 October 2011) and had a pre-specified protocol covering primary analysis. There was no published protocol for the current secondary analyses presented in this manuscript. BioMed Central 2017-02-08 /pmc/articles/PMC6457137/ /pubmed/31093533 http://dx.doi.org/10.1186/s41512-016-0006-6 Text en © The Author(s) 2017 Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated. |
spellingShingle | Research Whittle, Rebecca Royle, Kara-Louise Jordan, Kelvin P. Riley, Richard D. Mallen, Christian D. Peat, George Prognosis research ideally should measure time-varying predictors at their intended moment of use |
title | Prognosis research ideally should measure time-varying predictors at their intended moment of use |
title_full | Prognosis research ideally should measure time-varying predictors at their intended moment of use |
title_fullStr | Prognosis research ideally should measure time-varying predictors at their intended moment of use |
title_full_unstemmed | Prognosis research ideally should measure time-varying predictors at their intended moment of use |
title_short | Prognosis research ideally should measure time-varying predictors at their intended moment of use |
title_sort | prognosis research ideally should measure time-varying predictors at their intended moment of use |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6457137/ https://www.ncbi.nlm.nih.gov/pubmed/31093533 http://dx.doi.org/10.1186/s41512-016-0006-6 |
work_keys_str_mv | AT whittlerebecca prognosisresearchideallyshouldmeasuretimevaryingpredictorsattheirintendedmomentofuse AT roylekaralouise prognosisresearchideallyshouldmeasuretimevaryingpredictorsattheirintendedmomentofuse AT jordankelvinp prognosisresearchideallyshouldmeasuretimevaryingpredictorsattheirintendedmomentofuse AT rileyrichardd prognosisresearchideallyshouldmeasuretimevaryingpredictorsattheirintendedmomentofuse AT mallenchristiand prognosisresearchideallyshouldmeasuretimevaryingpredictorsattheirintendedmomentofuse AT peatgeorge prognosisresearchideallyshouldmeasuretimevaryingpredictorsattheirintendedmomentofuse |