Cargando…

RipetaScore: Measuring the Quality, Transparency, and Trustworthiness of a Scientific Work

A wide array of existing metrics quantifies a scientific paper's prominence or the author's prestige. Many who use these metrics make assumptions that higher citation counts or more public attention must indicate more reliable, better quality science. While current metrics offer valuable i...

Descripción completa

Detalles Bibliográficos
Autores principales: Sumner, Josh Q., Vitale, Cynthia Hudson, McIntosh, Leslie D.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8814593/
https://www.ncbi.nlm.nih.gov/pubmed/35128302
http://dx.doi.org/10.3389/frma.2021.751734
_version_ 1784645098502356992
author Sumner, Josh Q.
Vitale, Cynthia Hudson
McIntosh, Leslie D.
author_facet Sumner, Josh Q.
Vitale, Cynthia Hudson
McIntosh, Leslie D.
author_sort Sumner, Josh Q.
collection PubMed
description A wide array of existing metrics quantifies a scientific paper's prominence or the author's prestige. Many who use these metrics make assumptions that higher citation counts or more public attention must indicate more reliable, better quality science. While current metrics offer valuable insight into scientific publications, they are an inadequate proxy for measuring the quality, transparency, and trustworthiness of published research. Three essential elements to establishing trust in a work include: trust in the paper, trust in the author, and trust in the data. To address these elements in a systematic and automated way, we propose the ripetaScore as a direct measurement of a paper's research practices, professionalism, and reproducibility. Using a sample of our current corpus of academic papers, we demonstrate the ripetaScore's efficacy in determining the quality, transparency, and trustworthiness of an academic work. In this paper, we aim to provide a metric to evaluate scientific reporting quality in terms of transparency and trustworthiness of the research, professionalism, and reproducibility.
format Online
Article
Text
id pubmed-8814593
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-88145932022-02-05 RipetaScore: Measuring the Quality, Transparency, and Trustworthiness of a Scientific Work Sumner, Josh Q. Vitale, Cynthia Hudson McIntosh, Leslie D. Front Res Metr Anal Research Metrics and Analytics A wide array of existing metrics quantifies a scientific paper's prominence or the author's prestige. Many who use these metrics make assumptions that higher citation counts or more public attention must indicate more reliable, better quality science. While current metrics offer valuable insight into scientific publications, they are an inadequate proxy for measuring the quality, transparency, and trustworthiness of published research. Three essential elements to establishing trust in a work include: trust in the paper, trust in the author, and trust in the data. To address these elements in a systematic and automated way, we propose the ripetaScore as a direct measurement of a paper's research practices, professionalism, and reproducibility. Using a sample of our current corpus of academic papers, we demonstrate the ripetaScore's efficacy in determining the quality, transparency, and trustworthiness of an academic work. In this paper, we aim to provide a metric to evaluate scientific reporting quality in terms of transparency and trustworthiness of the research, professionalism, and reproducibility. Frontiers Media S.A. 2022-01-21 /pmc/articles/PMC8814593/ /pubmed/35128302 http://dx.doi.org/10.3389/frma.2021.751734 Text en Copyright © 2022 Sumner, Vitale and McIntosh. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Research Metrics and Analytics
Sumner, Josh Q.
Vitale, Cynthia Hudson
McIntosh, Leslie D.
RipetaScore: Measuring the Quality, Transparency, and Trustworthiness of a Scientific Work
title RipetaScore: Measuring the Quality, Transparency, and Trustworthiness of a Scientific Work
title_full RipetaScore: Measuring the Quality, Transparency, and Trustworthiness of a Scientific Work
title_fullStr RipetaScore: Measuring the Quality, Transparency, and Trustworthiness of a Scientific Work
title_full_unstemmed RipetaScore: Measuring the Quality, Transparency, and Trustworthiness of a Scientific Work
title_short RipetaScore: Measuring the Quality, Transparency, and Trustworthiness of a Scientific Work
title_sort ripetascore: measuring the quality, transparency, and trustworthiness of a scientific work
topic Research Metrics and Analytics
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8814593/
https://www.ncbi.nlm.nih.gov/pubmed/35128302
http://dx.doi.org/10.3389/frma.2021.751734
work_keys_str_mv AT sumnerjoshq ripetascoremeasuringthequalitytransparencyandtrustworthinessofascientificwork
AT vitalecynthiahudson ripetascoremeasuringthequalitytransparencyandtrustworthinessofascientificwork
AT mcintoshleslied ripetascoremeasuringthequalitytransparencyandtrustworthinessofascientificwork