Cargando…

Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research

OBJECTIVES: To evaluate (1) the feasibility of an audit-feedback intervention to facilitate sports science journal policy change, (2) the reliability of the Transparency of Research Underpinning Social Intervention Tiers (TRUST) policy evaluation form, and (3) the extent to which policies of sports...

Descripción completa

Detalles Bibliográficos
Autores principales: Hansford, Harrison J., Cashin, Aidan G., Bagg, Matthew K., Wewege, Michael A., Ferraro, Michael C., Kianersi, Sina, Mayo-Wilson, Evan, Grant, Sean P., Toomey, Elaine, Skinner, Ian W., McAuley, James H., Lee, Hopin, Jones, Matthew D.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9357245/
https://www.ncbi.nlm.nih.gov/pubmed/35932429
http://dx.doi.org/10.1186/s40798-022-00496-x
_version_ 1784763670120628224
author Hansford, Harrison J.
Cashin, Aidan G.
Bagg, Matthew K.
Wewege, Michael A.
Ferraro, Michael C.
Kianersi, Sina
Mayo-Wilson, Evan
Grant, Sean P.
Toomey, Elaine
Skinner, Ian W.
McAuley, James H.
Lee, Hopin
Jones, Matthew D.
author_facet Hansford, Harrison J.
Cashin, Aidan G.
Bagg, Matthew K.
Wewege, Michael A.
Ferraro, Michael C.
Kianersi, Sina
Mayo-Wilson, Evan
Grant, Sean P.
Toomey, Elaine
Skinner, Ian W.
McAuley, James H.
Lee, Hopin
Jones, Matthew D.
author_sort Hansford, Harrison J.
collection PubMed
description OBJECTIVES: To evaluate (1) the feasibility of an audit-feedback intervention to facilitate sports science journal policy change, (2) the reliability of the Transparency of Research Underpinning Social Intervention Tiers (TRUST) policy evaluation form, and (3) the extent to which policies of sports science journals support transparent and open research practices. METHODS: We conducted a cross-sectional, audit-feedback, feasibility study of transparency and openness standards of the top 38 sports science journals by impact factor. The TRUST form was used to evaluate journal policies support for transparent and open research practices. Feedback was provided to journal editors in the format of a tailored letter. Inter-rater reliability and agreement of the TRUST form was assessed using intraclass correlation coefficients and the standard error of measurement, respectively. Time-based criteria, fidelity of intervention delivery and qualitative feedback were used to determine feasibility. RESULTS: The audit-feedback intervention was feasible based on the time taken to rate journals and provide tailored feedback. The mean (SD) score on the TRUST form (range 0–27) was 2.05 (1.99), reflecting low engagement with transparent and open practices. Inter-rater reliability of the overall score of the TRUST form was moderate [ICC (2,1) = 0.68 (95% CI 0.55–0.79)], with standard error of measurement of 1.17. However, some individual items had poor reliability. CONCLUSION: Policies of the top 38 sports science journals have potential for improved support for transparent and open research practices. The feasible audit-feedback intervention developed here warrants large-scale evaluation as a means to facilitate change in journal policies. Registration: OSF (https://osf.io/d2t4s/). SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s40798-022-00496-x.
format Online
Article
Text
id pubmed-9357245
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-93572452022-08-08 Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research Hansford, Harrison J. Cashin, Aidan G. Bagg, Matthew K. Wewege, Michael A. Ferraro, Michael C. Kianersi, Sina Mayo-Wilson, Evan Grant, Sean P. Toomey, Elaine Skinner, Ian W. McAuley, James H. Lee, Hopin Jones, Matthew D. Sports Med Open Original Research Article OBJECTIVES: To evaluate (1) the feasibility of an audit-feedback intervention to facilitate sports science journal policy change, (2) the reliability of the Transparency of Research Underpinning Social Intervention Tiers (TRUST) policy evaluation form, and (3) the extent to which policies of sports science journals support transparent and open research practices. METHODS: We conducted a cross-sectional, audit-feedback, feasibility study of transparency and openness standards of the top 38 sports science journals by impact factor. The TRUST form was used to evaluate journal policies support for transparent and open research practices. Feedback was provided to journal editors in the format of a tailored letter. Inter-rater reliability and agreement of the TRUST form was assessed using intraclass correlation coefficients and the standard error of measurement, respectively. Time-based criteria, fidelity of intervention delivery and qualitative feedback were used to determine feasibility. RESULTS: The audit-feedback intervention was feasible based on the time taken to rate journals and provide tailored feedback. The mean (SD) score on the TRUST form (range 0–27) was 2.05 (1.99), reflecting low engagement with transparent and open practices. Inter-rater reliability of the overall score of the TRUST form was moderate [ICC (2,1) = 0.68 (95% CI 0.55–0.79)], with standard error of measurement of 1.17. However, some individual items had poor reliability. CONCLUSION: Policies of the top 38 sports science journals have potential for improved support for transparent and open research practices. The feasible audit-feedback intervention developed here warrants large-scale evaluation as a means to facilitate change in journal policies. Registration: OSF (https://osf.io/d2t4s/). SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s40798-022-00496-x. Springer International Publishing 2022-08-06 /pmc/articles/PMC9357245/ /pubmed/35932429 http://dx.doi.org/10.1186/s40798-022-00496-x Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Original Research Article
Hansford, Harrison J.
Cashin, Aidan G.
Bagg, Matthew K.
Wewege, Michael A.
Ferraro, Michael C.
Kianersi, Sina
Mayo-Wilson, Evan
Grant, Sean P.
Toomey, Elaine
Skinner, Ian W.
McAuley, James H.
Lee, Hopin
Jones, Matthew D.
Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research
title Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research
title_full Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research
title_fullStr Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research
title_full_unstemmed Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research
title_short Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research
title_sort feasibility of an audit and feedback intervention to facilitate journal policy change towards greater promotion of transparency and openness in sports science research
topic Original Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9357245/
https://www.ncbi.nlm.nih.gov/pubmed/35932429
http://dx.doi.org/10.1186/s40798-022-00496-x
work_keys_str_mv AT hansfordharrisonj feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch
AT cashinaidang feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch
AT baggmatthewk feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch
AT wewegemichaela feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch
AT ferraromichaelc feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch
AT kianersisina feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch
AT mayowilsonevan feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch
AT grantseanp feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch
AT toomeyelaine feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch
AT skinnerianw feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch
AT mcauleyjamesh feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch
AT leehopin feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch
AT jonesmatthewd feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch