Cargando…

Time to publication among completed diagnostic accuracy studies: associated with reported accuracy estimates

BACKGROUND: Previous evaluations have documented that studies evaluating the effectiveness of therapeutic interventions are not always reported, and that those with statistically significant results are published more rapidly than those without. This can lead to reporting bias in systematic reviews...

Descripción completa

Detalles Bibliográficos
Autores principales: Korevaar, Daniël A., van Es, Nick, Zwinderman, Aeilko H., Cohen, Jérémie F., Bossuyt, Patrick M. M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4896017/
https://www.ncbi.nlm.nih.gov/pubmed/27267602
http://dx.doi.org/10.1186/s12874-016-0177-4
_version_ 1782435970252013568
author Korevaar, Daniël A.
van Es, Nick
Zwinderman, Aeilko H.
Cohen, Jérémie F.
Bossuyt, Patrick M. M.
author_facet Korevaar, Daniël A.
van Es, Nick
Zwinderman, Aeilko H.
Cohen, Jérémie F.
Bossuyt, Patrick M. M.
author_sort Korevaar, Daniël A.
collection PubMed
description BACKGROUND: Previous evaluations have documented that studies evaluating the effectiveness of therapeutic interventions are not always reported, and that those with statistically significant results are published more rapidly than those without. This can lead to reporting bias in systematic reviews and other literature syntheses. We evaluated whether diagnostic accuracy studies that report promising results about the performance of medical tests are also published more rapidly. METHODS: We obtained all primary diagnostic accuracy studies included in meta-analyses of Medline-indexed systematic reviews that were published between September 2011 and January 2012. For each primary study, we extracted estimates of diagnostic accuracy (sensitivity, specificity, Youden’s index), the completion date of participant recruitment, and the publication date. We calculated the time from completion to publication and assessed associations with reported accuracy estimates. RESULTS: Forty-nine systematic reviews were identified, containing 92 meta-analyses and 924 unique primary studies, of which 756 could be included. Study completion dates were missing for 285 (38 %) of these. Median time from completion to publication in the remaining 471 studies was 24 months (IQR 16 to 35). Primary studies that reported higher estimates of sensitivity (Spearman’s rho = −0.14; p = 0.003), specificity (rho = −0.17; p < 0.001), and Youden’s index (rho = −0.22; p < 0.001) had significantly shorter times to publication. When comparing time to publication in studies reporting accuracy estimates above versus below the median, the median number of months was 23 versus 25 for sensitivity (p = 0.046), 22 versus 27 for specificity (p = 0.001), and 22 versus 27 for Youden’s index (p < 0.001). These differential time lags remained significant in multivariable Cox regression analyses with adjustment for other study characteristics, with hazard ratios of publication of 1.06 (95 % CI 1.02 to 1.11; p = 0.007) for logit-transformed estimates of sensitivity, 1.09 (95 % CI 1.04 to 1.14; p < 0.001) for logit-transformed estimates of specificity, and 1.09 (95 % CI 1.03 to 1.14; p = 0.001) for logit-transformed estimates of Youden’s index. CONCLUSIONS: Time to publication was significantly shorter for studies reporting higher estimates of diagnostic accuracy compared to those reporting lower estimates. This suggests that searching and analyzing the published literature, rather than all completed studies, can produce a biased view of the performance of medical tests. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s12874-016-0177-4) contains supplementary material, which is available to authorized users.
format Online
Article
Text
id pubmed-4896017
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-48960172016-06-08 Time to publication among completed diagnostic accuracy studies: associated with reported accuracy estimates Korevaar, Daniël A. van Es, Nick Zwinderman, Aeilko H. Cohen, Jérémie F. Bossuyt, Patrick M. M. BMC Med Res Methodol Research Article BACKGROUND: Previous evaluations have documented that studies evaluating the effectiveness of therapeutic interventions are not always reported, and that those with statistically significant results are published more rapidly than those without. This can lead to reporting bias in systematic reviews and other literature syntheses. We evaluated whether diagnostic accuracy studies that report promising results about the performance of medical tests are also published more rapidly. METHODS: We obtained all primary diagnostic accuracy studies included in meta-analyses of Medline-indexed systematic reviews that were published between September 2011 and January 2012. For each primary study, we extracted estimates of diagnostic accuracy (sensitivity, specificity, Youden’s index), the completion date of participant recruitment, and the publication date. We calculated the time from completion to publication and assessed associations with reported accuracy estimates. RESULTS: Forty-nine systematic reviews were identified, containing 92 meta-analyses and 924 unique primary studies, of which 756 could be included. Study completion dates were missing for 285 (38 %) of these. Median time from completion to publication in the remaining 471 studies was 24 months (IQR 16 to 35). Primary studies that reported higher estimates of sensitivity (Spearman’s rho = −0.14; p = 0.003), specificity (rho = −0.17; p < 0.001), and Youden’s index (rho = −0.22; p < 0.001) had significantly shorter times to publication. When comparing time to publication in studies reporting accuracy estimates above versus below the median, the median number of months was 23 versus 25 for sensitivity (p = 0.046), 22 versus 27 for specificity (p = 0.001), and 22 versus 27 for Youden’s index (p < 0.001). These differential time lags remained significant in multivariable Cox regression analyses with adjustment for other study characteristics, with hazard ratios of publication of 1.06 (95 % CI 1.02 to 1.11; p = 0.007) for logit-transformed estimates of sensitivity, 1.09 (95 % CI 1.04 to 1.14; p < 0.001) for logit-transformed estimates of specificity, and 1.09 (95 % CI 1.03 to 1.14; p = 0.001) for logit-transformed estimates of Youden’s index. CONCLUSIONS: Time to publication was significantly shorter for studies reporting higher estimates of diagnostic accuracy compared to those reporting lower estimates. This suggests that searching and analyzing the published literature, rather than all completed studies, can produce a biased view of the performance of medical tests. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s12874-016-0177-4) contains supplementary material, which is available to authorized users. BioMed Central 2016-06-06 /pmc/articles/PMC4896017/ /pubmed/27267602 http://dx.doi.org/10.1186/s12874-016-0177-4 Text en © The Author(s). 2016 Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
spellingShingle Research Article
Korevaar, Daniël A.
van Es, Nick
Zwinderman, Aeilko H.
Cohen, Jérémie F.
Bossuyt, Patrick M. M.
Time to publication among completed diagnostic accuracy studies: associated with reported accuracy estimates
title Time to publication among completed diagnostic accuracy studies: associated with reported accuracy estimates
title_full Time to publication among completed diagnostic accuracy studies: associated with reported accuracy estimates
title_fullStr Time to publication among completed diagnostic accuracy studies: associated with reported accuracy estimates
title_full_unstemmed Time to publication among completed diagnostic accuracy studies: associated with reported accuracy estimates
title_short Time to publication among completed diagnostic accuracy studies: associated with reported accuracy estimates
title_sort time to publication among completed diagnostic accuracy studies: associated with reported accuracy estimates
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4896017/
https://www.ncbi.nlm.nih.gov/pubmed/27267602
http://dx.doi.org/10.1186/s12874-016-0177-4
work_keys_str_mv AT korevaardaniela timetopublicationamongcompleteddiagnosticaccuracystudiesassociatedwithreportedaccuracyestimates
AT vanesnick timetopublicationamongcompleteddiagnosticaccuracystudiesassociatedwithreportedaccuracyestimates
AT zwindermanaeilkoh timetopublicationamongcompleteddiagnosticaccuracystudiesassociatedwithreportedaccuracyestimates
AT cohenjeremief timetopublicationamongcompleteddiagnosticaccuracystudiesassociatedwithreportedaccuracyestimates
AT bossuytpatrickmm timetopublicationamongcompleteddiagnosticaccuracystudiesassociatedwithreportedaccuracyestimates