Cargando…

Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics

Reproducible research serves as a pillar of the scientific method and is a foundation for scientific advancement. However, estimates for irreproducibility of preclinical science range from 75% to 90%. The importance of reproducible science has not been assessed in the context of mechanics‐based mode...

Descripción completa

Detalles Bibliográficos
Autores principales: Halloran, Jason P., Abdollahi Nohouji, Neda, Hafez, Mhd A., Besier, Thor F., Chokhandre, Snehal K., Elmasry, Shady, Hume, Donald R., Imhauser, Carl W., Rooks, Nynke B., Schneider, Marco T. Y., Schwartz, Ariel, Shelburne, Kevin B., Zaylor, William, Erdemir, Ahmet
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9630164/
https://www.ncbi.nlm.nih.gov/pubmed/35502762
http://dx.doi.org/10.1002/jor.25358
_version_ 1784823541332443136
author Halloran, Jason P.
Abdollahi Nohouji, Neda
Hafez, Mhd A.
Besier, Thor F.
Chokhandre, Snehal K.
Elmasry, Shady
Hume, Donald R.
Imhauser, Carl W.
Rooks, Nynke B.
Schneider, Marco T. Y.
Schwartz, Ariel
Shelburne, Kevin B.
Zaylor, William
Erdemir, Ahmet
author_facet Halloran, Jason P.
Abdollahi Nohouji, Neda
Hafez, Mhd A.
Besier, Thor F.
Chokhandre, Snehal K.
Elmasry, Shady
Hume, Donald R.
Imhauser, Carl W.
Rooks, Nynke B.
Schneider, Marco T. Y.
Schwartz, Ariel
Shelburne, Kevin B.
Zaylor, William
Erdemir, Ahmet
author_sort Halloran, Jason P.
collection PubMed
description Reproducible research serves as a pillar of the scientific method and is a foundation for scientific advancement. However, estimates for irreproducibility of preclinical science range from 75% to 90%. The importance of reproducible science has not been assessed in the context of mechanics‐based modeling of human joints such as the knee, despite this being an area that has seen dramatic growth. Framed in the context of five experienced teams currently documenting knee modeling procedures, the aim of this study was to evaluate reporting and the perceived potential for reproducibility across studies the teams viewed as important contributions to the literature. A cohort of studies was selected by polling, which resulted in an assessment of nine studies as opposed to a broader analysis across the literature. Using a published checklist for reporting of modeling features, the cohort was evaluated for both “reporting” and their potential to be “reproduced,” which was delineated into six major modeling categories and three subcategories. Logistic regression analysis revealed that for individual modeling categories, the proportion of “reported” occurrences ranged from 0.31, 95% confidence interval (CI) [0.23, 0.41] to 0.77, 95% CI: [0.68, 0.86]. The proportion of whether a category was perceived as “reproducible” ranged from 0.22, 95% CI: [0.15, 0.31] to 0.44, 95% CI: [0.35, 0.55]. The relatively low ratios highlight an opportunity to improve reporting and reproducibility of knee modeling studies. Ongoing efforts, including our findings, contribute to a dialogue that facilitates adoption of practices that provide both credibility and translation possibilities.
format Online
Article
Text
id pubmed-9630164
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-96301642023-04-11 Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics Halloran, Jason P. Abdollahi Nohouji, Neda Hafez, Mhd A. Besier, Thor F. Chokhandre, Snehal K. Elmasry, Shady Hume, Donald R. Imhauser, Carl W. Rooks, Nynke B. Schneider, Marco T. Y. Schwartz, Ariel Shelburne, Kevin B. Zaylor, William Erdemir, Ahmet J Orthop Res Research Articles Reproducible research serves as a pillar of the scientific method and is a foundation for scientific advancement. However, estimates for irreproducibility of preclinical science range from 75% to 90%. The importance of reproducible science has not been assessed in the context of mechanics‐based modeling of human joints such as the knee, despite this being an area that has seen dramatic growth. Framed in the context of five experienced teams currently documenting knee modeling procedures, the aim of this study was to evaluate reporting and the perceived potential for reproducibility across studies the teams viewed as important contributions to the literature. A cohort of studies was selected by polling, which resulted in an assessment of nine studies as opposed to a broader analysis across the literature. Using a published checklist for reporting of modeling features, the cohort was evaluated for both “reporting” and their potential to be “reproduced,” which was delineated into six major modeling categories and three subcategories. Logistic regression analysis revealed that for individual modeling categories, the proportion of “reported” occurrences ranged from 0.31, 95% confidence interval (CI) [0.23, 0.41] to 0.77, 95% CI: [0.68, 0.86]. The proportion of whether a category was perceived as “reproducible” ranged from 0.22, 95% CI: [0.15, 0.31] to 0.44, 95% CI: [0.35, 0.55]. The relatively low ratios highlight an opportunity to improve reporting and reproducibility of knee modeling studies. Ongoing efforts, including our findings, contribute to a dialogue that facilitates adoption of practices that provide both credibility and translation possibilities. John Wiley and Sons Inc. 2022-05-22 2023-02 /pmc/articles/PMC9630164/ /pubmed/35502762 http://dx.doi.org/10.1002/jor.25358 Text en © 2022 The Authors. Journal of Orthopaedic Research ® published by Wiley Periodicals LLC on behalf of Orthopaedic Research Society. https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Articles
Halloran, Jason P.
Abdollahi Nohouji, Neda
Hafez, Mhd A.
Besier, Thor F.
Chokhandre, Snehal K.
Elmasry, Shady
Hume, Donald R.
Imhauser, Carl W.
Rooks, Nynke B.
Schneider, Marco T. Y.
Schwartz, Ariel
Shelburne, Kevin B.
Zaylor, William
Erdemir, Ahmet
Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics
title Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics
title_full Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics
title_fullStr Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics
title_full_unstemmed Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics
title_short Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics
title_sort assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics
topic Research Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9630164/
https://www.ncbi.nlm.nih.gov/pubmed/35502762
http://dx.doi.org/10.1002/jor.25358
work_keys_str_mv AT halloranjasonp assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT abdollahinohoujineda assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT hafezmhda assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT besierthorf assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT chokhandresnehalk assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT elmasryshady assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT humedonaldr assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT imhausercarlw assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT rooksnynkeb assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT schneidermarcoty assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT schwartzariel assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT shelburnekevinb assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT zaylorwilliam assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics
AT erdemirahmet assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics