Cargando…

Meta-research evaluating redundancy and use of systematic reviews when planning new studies in health research: a scoping review

BACKGROUND: Several studies have documented the production of wasteful research, defined as research of no scientific importance and/or not meeting societal needs. We argue that this redundancy in research may to a large degree be due to the lack of a systematic evaluation of the best available evid...

Descripción completa

Detalles Bibliográficos
Autores principales: Lund, Hans, Robinson, Karen A., Gjerland, Ane, Nykvist, Hanna, Drachen, Thea Marie, Christensen, Robin, Juhl, Carsten Bogh, Jamtvedt, Gro, Nortvedt, Monica, Bjerrum, Merete, Westmore, Matt, Yost, Jennifer, Brunnhuber, Klara
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9667610/
https://www.ncbi.nlm.nih.gov/pubmed/36380367
http://dx.doi.org/10.1186/s13643-022-02096-y
_version_ 1784831757098418176
author Lund, Hans
Robinson, Karen A.
Gjerland, Ane
Nykvist, Hanna
Drachen, Thea Marie
Christensen, Robin
Juhl, Carsten Bogh
Jamtvedt, Gro
Nortvedt, Monica
Bjerrum, Merete
Westmore, Matt
Yost, Jennifer
Brunnhuber, Klara
author_facet Lund, Hans
Robinson, Karen A.
Gjerland, Ane
Nykvist, Hanna
Drachen, Thea Marie
Christensen, Robin
Juhl, Carsten Bogh
Jamtvedt, Gro
Nortvedt, Monica
Bjerrum, Merete
Westmore, Matt
Yost, Jennifer
Brunnhuber, Klara
author_sort Lund, Hans
collection PubMed
description BACKGROUND: Several studies have documented the production of wasteful research, defined as research of no scientific importance and/or not meeting societal needs. We argue that this redundancy in research may to a large degree be due to the lack of a systematic evaluation of the best available evidence and/or of studies assessing societal needs. OBJECTIVES: The aim of this scoping review is to (A) identify meta-research studies evaluating if redundancy is present within biomedical research, and if so, assessing the prevalence of such redundancy, and (B) to identify meta-research studies evaluating if researchers had been trying to minimise or avoid redundancy. ELIGIBILITY CRITERIA: Meta-research studies (empirical studies) were eligible if they evaluated whether redundancy was present and to what degree; whether health researchers referred to all earlier similar studies when justifying and designing a new study and/or when placing new results in the context of earlier similar trials; and whether health researchers systematically and transparently considered end users’ perspectives when justifying and designing a new study. SOURCES OF EVIDENCE: The initial overall search was conducted in MEDLINE, Embase via Ovid, CINAHL, Web of Science, Social Sciences Citation Index, Arts & Humanities Citation Index, and the Cochrane Methodology Register from inception to June 2015. A 2nd search included MEDLINE and Embase via Ovid and covered January 2015 to 26 May 2021. No publication date or language restrictions were applied. CHARTING METHODS: Charting methods included description of the included studies, bibliometric mapping, and presentation of possible research gaps in the identified meta-research. RESULTS: We identified 69 meta-research studies. Thirty-four (49%) of these evaluated the prevalence of redundancy and 42 (61%) studies evaluated the prevalence of a systematic and transparent use of earlier similar studies when justifying and designing new studies, and/or when placing new results in context, with seven (10%) studies addressing both aspects. Only one (1%) study assessed if the perspectives of end users had been used to inform the justification and design of a new study. Among the included meta-research studies evaluating whether redundancy was present, only two of nine health domains (medical areas) and only two of 10 research topics (different methodological types) were represented. Similarly, among the included meta-research studies evaluating whether researchers had been trying to minimise or avoid redundancy, only one of nine health domains and only one of 10 research topics were represented. CONCLUSIONS THAT RELATE TO THE REVIEW QUESTIONS AND OBJECTIVES: Even with 69 included meta-research studies, there was a lack of information for most health domains and research topics. However, as most included studies were evaluating across different domains, there is a clear indication of a high prevalence of redundancy and a low prevalence of trying to minimise or avoid redundancy. In addition, only one meta-research study evaluated whether the perspectives of end users were used to inform the justification and design of a new study. SYSTEMATIC REVIEW REGISTRATION: Protocol registered at Open Science Framework: https://osf.io/3rdua/ (15 June 2021). SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13643-022-02096-y.
format Online
Article
Text
id pubmed-9667610
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-96676102022-11-17 Meta-research evaluating redundancy and use of systematic reviews when planning new studies in health research: a scoping review Lund, Hans Robinson, Karen A. Gjerland, Ane Nykvist, Hanna Drachen, Thea Marie Christensen, Robin Juhl, Carsten Bogh Jamtvedt, Gro Nortvedt, Monica Bjerrum, Merete Westmore, Matt Yost, Jennifer Brunnhuber, Klara Syst Rev Research BACKGROUND: Several studies have documented the production of wasteful research, defined as research of no scientific importance and/or not meeting societal needs. We argue that this redundancy in research may to a large degree be due to the lack of a systematic evaluation of the best available evidence and/or of studies assessing societal needs. OBJECTIVES: The aim of this scoping review is to (A) identify meta-research studies evaluating if redundancy is present within biomedical research, and if so, assessing the prevalence of such redundancy, and (B) to identify meta-research studies evaluating if researchers had been trying to minimise or avoid redundancy. ELIGIBILITY CRITERIA: Meta-research studies (empirical studies) were eligible if they evaluated whether redundancy was present and to what degree; whether health researchers referred to all earlier similar studies when justifying and designing a new study and/or when placing new results in the context of earlier similar trials; and whether health researchers systematically and transparently considered end users’ perspectives when justifying and designing a new study. SOURCES OF EVIDENCE: The initial overall search was conducted in MEDLINE, Embase via Ovid, CINAHL, Web of Science, Social Sciences Citation Index, Arts & Humanities Citation Index, and the Cochrane Methodology Register from inception to June 2015. A 2nd search included MEDLINE and Embase via Ovid and covered January 2015 to 26 May 2021. No publication date or language restrictions were applied. CHARTING METHODS: Charting methods included description of the included studies, bibliometric mapping, and presentation of possible research gaps in the identified meta-research. RESULTS: We identified 69 meta-research studies. Thirty-four (49%) of these evaluated the prevalence of redundancy and 42 (61%) studies evaluated the prevalence of a systematic and transparent use of earlier similar studies when justifying and designing new studies, and/or when placing new results in context, with seven (10%) studies addressing both aspects. Only one (1%) study assessed if the perspectives of end users had been used to inform the justification and design of a new study. Among the included meta-research studies evaluating whether redundancy was present, only two of nine health domains (medical areas) and only two of 10 research topics (different methodological types) were represented. Similarly, among the included meta-research studies evaluating whether researchers had been trying to minimise or avoid redundancy, only one of nine health domains and only one of 10 research topics were represented. CONCLUSIONS THAT RELATE TO THE REVIEW QUESTIONS AND OBJECTIVES: Even with 69 included meta-research studies, there was a lack of information for most health domains and research topics. However, as most included studies were evaluating across different domains, there is a clear indication of a high prevalence of redundancy and a low prevalence of trying to minimise or avoid redundancy. In addition, only one meta-research study evaluated whether the perspectives of end users were used to inform the justification and design of a new study. SYSTEMATIC REVIEW REGISTRATION: Protocol registered at Open Science Framework: https://osf.io/3rdua/ (15 June 2021). SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13643-022-02096-y. BioMed Central 2022-11-15 /pmc/articles/PMC9667610/ /pubmed/36380367 http://dx.doi.org/10.1186/s13643-022-02096-y Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research
Lund, Hans
Robinson, Karen A.
Gjerland, Ane
Nykvist, Hanna
Drachen, Thea Marie
Christensen, Robin
Juhl, Carsten Bogh
Jamtvedt, Gro
Nortvedt, Monica
Bjerrum, Merete
Westmore, Matt
Yost, Jennifer
Brunnhuber, Klara
Meta-research evaluating redundancy and use of systematic reviews when planning new studies in health research: a scoping review
title Meta-research evaluating redundancy and use of systematic reviews when planning new studies in health research: a scoping review
title_full Meta-research evaluating redundancy and use of systematic reviews when planning new studies in health research: a scoping review
title_fullStr Meta-research evaluating redundancy and use of systematic reviews when planning new studies in health research: a scoping review
title_full_unstemmed Meta-research evaluating redundancy and use of systematic reviews when planning new studies in health research: a scoping review
title_short Meta-research evaluating redundancy and use of systematic reviews when planning new studies in health research: a scoping review
title_sort meta-research evaluating redundancy and use of systematic reviews when planning new studies in health research: a scoping review
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9667610/
https://www.ncbi.nlm.nih.gov/pubmed/36380367
http://dx.doi.org/10.1186/s13643-022-02096-y
work_keys_str_mv AT lundhans metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT robinsonkarena metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT gjerlandane metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT nykvisthanna metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT drachentheamarie metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT christensenrobin metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT juhlcarstenbogh metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT jamtvedtgro metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT nortvedtmonica metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT bjerrummerete metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT westmorematt metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT yostjennifer metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT brunnhuberklara metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview
AT metaresearchevaluatingredundancyanduseofsystematicreviewswhenplanningnewstudiesinhealthresearchascopingreview