Cargando…
Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics
Reproducible research serves as a pillar of the scientific method and is a foundation for scientific advancement. However, estimates for irreproducibility of preclinical science range from 75% to 90%. The importance of reproducible science has not been assessed in the context of mechanics‐based mode...
Autores principales: | , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
John Wiley and Sons Inc.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9630164/ https://www.ncbi.nlm.nih.gov/pubmed/35502762 http://dx.doi.org/10.1002/jor.25358 |
_version_ | 1784823541332443136 |
---|---|
author | Halloran, Jason P. Abdollahi Nohouji, Neda Hafez, Mhd A. Besier, Thor F. Chokhandre, Snehal K. Elmasry, Shady Hume, Donald R. Imhauser, Carl W. Rooks, Nynke B. Schneider, Marco T. Y. Schwartz, Ariel Shelburne, Kevin B. Zaylor, William Erdemir, Ahmet |
author_facet | Halloran, Jason P. Abdollahi Nohouji, Neda Hafez, Mhd A. Besier, Thor F. Chokhandre, Snehal K. Elmasry, Shady Hume, Donald R. Imhauser, Carl W. Rooks, Nynke B. Schneider, Marco T. Y. Schwartz, Ariel Shelburne, Kevin B. Zaylor, William Erdemir, Ahmet |
author_sort | Halloran, Jason P. |
collection | PubMed |
description | Reproducible research serves as a pillar of the scientific method and is a foundation for scientific advancement. However, estimates for irreproducibility of preclinical science range from 75% to 90%. The importance of reproducible science has not been assessed in the context of mechanics‐based modeling of human joints such as the knee, despite this being an area that has seen dramatic growth. Framed in the context of five experienced teams currently documenting knee modeling procedures, the aim of this study was to evaluate reporting and the perceived potential for reproducibility across studies the teams viewed as important contributions to the literature. A cohort of studies was selected by polling, which resulted in an assessment of nine studies as opposed to a broader analysis across the literature. Using a published checklist for reporting of modeling features, the cohort was evaluated for both “reporting” and their potential to be “reproduced,” which was delineated into six major modeling categories and three subcategories. Logistic regression analysis revealed that for individual modeling categories, the proportion of “reported” occurrences ranged from 0.31, 95% confidence interval (CI) [0.23, 0.41] to 0.77, 95% CI: [0.68, 0.86]. The proportion of whether a category was perceived as “reproducible” ranged from 0.22, 95% CI: [0.15, 0.31] to 0.44, 95% CI: [0.35, 0.55]. The relatively low ratios highlight an opportunity to improve reporting and reproducibility of knee modeling studies. Ongoing efforts, including our findings, contribute to a dialogue that facilitates adoption of practices that provide both credibility and translation possibilities. |
format | Online Article Text |
id | pubmed-9630164 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | John Wiley and Sons Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-96301642023-04-11 Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics Halloran, Jason P. Abdollahi Nohouji, Neda Hafez, Mhd A. Besier, Thor F. Chokhandre, Snehal K. Elmasry, Shady Hume, Donald R. Imhauser, Carl W. Rooks, Nynke B. Schneider, Marco T. Y. Schwartz, Ariel Shelburne, Kevin B. Zaylor, William Erdemir, Ahmet J Orthop Res Research Articles Reproducible research serves as a pillar of the scientific method and is a foundation for scientific advancement. However, estimates for irreproducibility of preclinical science range from 75% to 90%. The importance of reproducible science has not been assessed in the context of mechanics‐based modeling of human joints such as the knee, despite this being an area that has seen dramatic growth. Framed in the context of five experienced teams currently documenting knee modeling procedures, the aim of this study was to evaluate reporting and the perceived potential for reproducibility across studies the teams viewed as important contributions to the literature. A cohort of studies was selected by polling, which resulted in an assessment of nine studies as opposed to a broader analysis across the literature. Using a published checklist for reporting of modeling features, the cohort was evaluated for both “reporting” and their potential to be “reproduced,” which was delineated into six major modeling categories and three subcategories. Logistic regression analysis revealed that for individual modeling categories, the proportion of “reported” occurrences ranged from 0.31, 95% confidence interval (CI) [0.23, 0.41] to 0.77, 95% CI: [0.68, 0.86]. The proportion of whether a category was perceived as “reproducible” ranged from 0.22, 95% CI: [0.15, 0.31] to 0.44, 95% CI: [0.35, 0.55]. The relatively low ratios highlight an opportunity to improve reporting and reproducibility of knee modeling studies. Ongoing efforts, including our findings, contribute to a dialogue that facilitates adoption of practices that provide both credibility and translation possibilities. John Wiley and Sons Inc. 2022-05-22 2023-02 /pmc/articles/PMC9630164/ /pubmed/35502762 http://dx.doi.org/10.1002/jor.25358 Text en © 2022 The Authors. Journal of Orthopaedic Research ® published by Wiley Periodicals LLC on behalf of Orthopaedic Research Society. https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Articles Halloran, Jason P. Abdollahi Nohouji, Neda Hafez, Mhd A. Besier, Thor F. Chokhandre, Snehal K. Elmasry, Shady Hume, Donald R. Imhauser, Carl W. Rooks, Nynke B. Schneider, Marco T. Y. Schwartz, Ariel Shelburne, Kevin B. Zaylor, William Erdemir, Ahmet Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics |
title | Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics |
title_full | Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics |
title_fullStr | Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics |
title_full_unstemmed | Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics |
title_short | Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics |
title_sort | assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics |
topic | Research Articles |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9630164/ https://www.ncbi.nlm.nih.gov/pubmed/35502762 http://dx.doi.org/10.1002/jor.25358 |
work_keys_str_mv | AT halloranjasonp assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT abdollahinohoujineda assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT hafezmhda assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT besierthorf assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT chokhandresnehalk assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT elmasryshady assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT humedonaldr assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT imhausercarlw assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT rooksnynkeb assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT schneidermarcoty assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT schwartzariel assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT shelburnekevinb assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT zaylorwilliam assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics AT erdemirahmet assessmentofreportingpracticesandreproducibilitypotentialofacohortofpublishedstudiesincomputationalkneebiomechanics |