Cargando…
Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research
OBJECTIVES: To evaluate (1) the feasibility of an audit-feedback intervention to facilitate sports science journal policy change, (2) the reliability of the Transparency of Research Underpinning Social Intervention Tiers (TRUST) policy evaluation form, and (3) the extent to which policies of sports...
Autores principales: | , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer International Publishing
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9357245/ https://www.ncbi.nlm.nih.gov/pubmed/35932429 http://dx.doi.org/10.1186/s40798-022-00496-x |
_version_ | 1784763670120628224 |
---|---|
author | Hansford, Harrison J. Cashin, Aidan G. Bagg, Matthew K. Wewege, Michael A. Ferraro, Michael C. Kianersi, Sina Mayo-Wilson, Evan Grant, Sean P. Toomey, Elaine Skinner, Ian W. McAuley, James H. Lee, Hopin Jones, Matthew D. |
author_facet | Hansford, Harrison J. Cashin, Aidan G. Bagg, Matthew K. Wewege, Michael A. Ferraro, Michael C. Kianersi, Sina Mayo-Wilson, Evan Grant, Sean P. Toomey, Elaine Skinner, Ian W. McAuley, James H. Lee, Hopin Jones, Matthew D. |
author_sort | Hansford, Harrison J. |
collection | PubMed |
description | OBJECTIVES: To evaluate (1) the feasibility of an audit-feedback intervention to facilitate sports science journal policy change, (2) the reliability of the Transparency of Research Underpinning Social Intervention Tiers (TRUST) policy evaluation form, and (3) the extent to which policies of sports science journals support transparent and open research practices. METHODS: We conducted a cross-sectional, audit-feedback, feasibility study of transparency and openness standards of the top 38 sports science journals by impact factor. The TRUST form was used to evaluate journal policies support for transparent and open research practices. Feedback was provided to journal editors in the format of a tailored letter. Inter-rater reliability and agreement of the TRUST form was assessed using intraclass correlation coefficients and the standard error of measurement, respectively. Time-based criteria, fidelity of intervention delivery and qualitative feedback were used to determine feasibility. RESULTS: The audit-feedback intervention was feasible based on the time taken to rate journals and provide tailored feedback. The mean (SD) score on the TRUST form (range 0–27) was 2.05 (1.99), reflecting low engagement with transparent and open practices. Inter-rater reliability of the overall score of the TRUST form was moderate [ICC (2,1) = 0.68 (95% CI 0.55–0.79)], with standard error of measurement of 1.17. However, some individual items had poor reliability. CONCLUSION: Policies of the top 38 sports science journals have potential for improved support for transparent and open research practices. The feasible audit-feedback intervention developed here warrants large-scale evaluation as a means to facilitate change in journal policies. Registration: OSF (https://osf.io/d2t4s/). SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s40798-022-00496-x. |
format | Online Article Text |
id | pubmed-9357245 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Springer International Publishing |
record_format | MEDLINE/PubMed |
spelling | pubmed-93572452022-08-08 Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research Hansford, Harrison J. Cashin, Aidan G. Bagg, Matthew K. Wewege, Michael A. Ferraro, Michael C. Kianersi, Sina Mayo-Wilson, Evan Grant, Sean P. Toomey, Elaine Skinner, Ian W. McAuley, James H. Lee, Hopin Jones, Matthew D. Sports Med Open Original Research Article OBJECTIVES: To evaluate (1) the feasibility of an audit-feedback intervention to facilitate sports science journal policy change, (2) the reliability of the Transparency of Research Underpinning Social Intervention Tiers (TRUST) policy evaluation form, and (3) the extent to which policies of sports science journals support transparent and open research practices. METHODS: We conducted a cross-sectional, audit-feedback, feasibility study of transparency and openness standards of the top 38 sports science journals by impact factor. The TRUST form was used to evaluate journal policies support for transparent and open research practices. Feedback was provided to journal editors in the format of a tailored letter. Inter-rater reliability and agreement of the TRUST form was assessed using intraclass correlation coefficients and the standard error of measurement, respectively. Time-based criteria, fidelity of intervention delivery and qualitative feedback were used to determine feasibility. RESULTS: The audit-feedback intervention was feasible based on the time taken to rate journals and provide tailored feedback. The mean (SD) score on the TRUST form (range 0–27) was 2.05 (1.99), reflecting low engagement with transparent and open practices. Inter-rater reliability of the overall score of the TRUST form was moderate [ICC (2,1) = 0.68 (95% CI 0.55–0.79)], with standard error of measurement of 1.17. However, some individual items had poor reliability. CONCLUSION: Policies of the top 38 sports science journals have potential for improved support for transparent and open research practices. The feasible audit-feedback intervention developed here warrants large-scale evaluation as a means to facilitate change in journal policies. Registration: OSF (https://osf.io/d2t4s/). SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s40798-022-00496-x. Springer International Publishing 2022-08-06 /pmc/articles/PMC9357245/ /pubmed/35932429 http://dx.doi.org/10.1186/s40798-022-00496-x Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Original Research Article Hansford, Harrison J. Cashin, Aidan G. Bagg, Matthew K. Wewege, Michael A. Ferraro, Michael C. Kianersi, Sina Mayo-Wilson, Evan Grant, Sean P. Toomey, Elaine Skinner, Ian W. McAuley, James H. Lee, Hopin Jones, Matthew D. Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research |
title | Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research |
title_full | Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research |
title_fullStr | Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research |
title_full_unstemmed | Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research |
title_short | Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research |
title_sort | feasibility of an audit and feedback intervention to facilitate journal policy change towards greater promotion of transparency and openness in sports science research |
topic | Original Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9357245/ https://www.ncbi.nlm.nih.gov/pubmed/35932429 http://dx.doi.org/10.1186/s40798-022-00496-x |
work_keys_str_mv | AT hansfordharrisonj feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch AT cashinaidang feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch AT baggmatthewk feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch AT wewegemichaela feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch AT ferraromichaelc feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch AT kianersisina feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch AT mayowilsonevan feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch AT grantseanp feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch AT toomeyelaine feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch AT skinnerianw feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch AT mcauleyjamesh feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch AT leehopin feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch AT jonesmatthewd feasibilityofanauditandfeedbackinterventiontofacilitatejournalpolicychangetowardsgreaterpromotionoftransparencyandopennessinsportsscienceresearch |