Cargando…
Consensus-based guidance for conducting and reporting multi-analyst studies
Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each...
| Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Formato: | Online Artículo Texto |
| Lenguaje: | English |
| Publicado: |
eLife Sciences Publications, Ltd
2021
|
| Materias: | |
| Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8626083/ https://www.ncbi.nlm.nih.gov/pubmed/34751133 http://dx.doi.org/10.7554/eLife.72185 |
| _version_ | 1784606578219941888 |
|---|---|
| author | Aczel, Balazs Szaszi, Barnabas Nilsonne, Gustav van den Akker, Olmo R Albers, Casper J van Assen, Marcel ALM Bastiaansen, Jojanneke A Benjamin, Daniel Boehm, Udo Botvinik-Nezer, Rotem Bringmann, Laura F Busch, Niko A Caruyer, Emmanuel Cataldo, Andrea M Cowan, Nelson Delios, Andrew van Dongen, Noah NN Donkin, Chris van Doorn, Johnny B Dreber, Anna Dutilh, Gilles Egan, Gary F Gernsbacher, Morton Ann Hoekstra, Rink Hoffmann, Sabine Holzmeister, Felix Huber, Juergen Johannesson, Magnus Jonas, Kai J Kindel, Alexander T Kirchler, Michael Kunkels, Yoram K Lindsay, D Stephen Mangin, Jean-Francois Matzke, Dora Munafò, Marcus R Newell, Ben R Nosek, Brian A Poldrack, Russell A van Ravenzwaaij, Don Rieskamp, Jörg Salganik, Matthew J Sarafoglou, Alexandra Schonberg, Tom Schweinsberg, Martin Shanks, David Silberzahn, Raphael Simons, Daniel J Spellman, Barbara A St-Jean, Samuel Starns, Jeffrey J Uhlmann, Eric Luis Wicherts, Jelte Wagenmakers, Eric-Jan |
| author_facet | Aczel, Balazs Szaszi, Barnabas Nilsonne, Gustav van den Akker, Olmo R Albers, Casper J van Assen, Marcel ALM Bastiaansen, Jojanneke A Benjamin, Daniel Boehm, Udo Botvinik-Nezer, Rotem Bringmann, Laura F Busch, Niko A Caruyer, Emmanuel Cataldo, Andrea M Cowan, Nelson Delios, Andrew van Dongen, Noah NN Donkin, Chris van Doorn, Johnny B Dreber, Anna Dutilh, Gilles Egan, Gary F Gernsbacher, Morton Ann Hoekstra, Rink Hoffmann, Sabine Holzmeister, Felix Huber, Juergen Johannesson, Magnus Jonas, Kai J Kindel, Alexander T Kirchler, Michael Kunkels, Yoram K Lindsay, D Stephen Mangin, Jean-Francois Matzke, Dora Munafò, Marcus R Newell, Ben R Nosek, Brian A Poldrack, Russell A van Ravenzwaaij, Don Rieskamp, Jörg Salganik, Matthew J Sarafoglou, Alexandra Schonberg, Tom Schweinsberg, Martin Shanks, David Silberzahn, Raphael Simons, Daniel J Spellman, Barbara A St-Jean, Samuel Starns, Jeffrey J Uhlmann, Eric Luis Wicherts, Jelte Wagenmakers, Eric-Jan |
| author_sort | Aczel, Balazs |
| collection | PubMed |
| description | Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research. |
| format | Online Article Text |
| id | pubmed-8626083 |
| institution | National Center for Biotechnology Information |
| language | English |
| publishDate | 2021 |
| publisher | eLife Sciences Publications, Ltd |
| record_format | MEDLINE/PubMed |
| spelling | pubmed-86260832021-11-29 Consensus-based guidance for conducting and reporting multi-analyst studies Aczel, Balazs Szaszi, Barnabas Nilsonne, Gustav van den Akker, Olmo R Albers, Casper J van Assen, Marcel ALM Bastiaansen, Jojanneke A Benjamin, Daniel Boehm, Udo Botvinik-Nezer, Rotem Bringmann, Laura F Busch, Niko A Caruyer, Emmanuel Cataldo, Andrea M Cowan, Nelson Delios, Andrew van Dongen, Noah NN Donkin, Chris van Doorn, Johnny B Dreber, Anna Dutilh, Gilles Egan, Gary F Gernsbacher, Morton Ann Hoekstra, Rink Hoffmann, Sabine Holzmeister, Felix Huber, Juergen Johannesson, Magnus Jonas, Kai J Kindel, Alexander T Kirchler, Michael Kunkels, Yoram K Lindsay, D Stephen Mangin, Jean-Francois Matzke, Dora Munafò, Marcus R Newell, Ben R Nosek, Brian A Poldrack, Russell A van Ravenzwaaij, Don Rieskamp, Jörg Salganik, Matthew J Sarafoglou, Alexandra Schonberg, Tom Schweinsberg, Martin Shanks, David Silberzahn, Raphael Simons, Daniel J Spellman, Barbara A St-Jean, Samuel Starns, Jeffrey J Uhlmann, Eric Luis Wicherts, Jelte Wagenmakers, Eric-Jan eLife Medicine Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research. eLife Sciences Publications, Ltd 2021-11-09 /pmc/articles/PMC8626083/ /pubmed/34751133 http://dx.doi.org/10.7554/eLife.72185 Text en © 2021, Aczel et al https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use and redistribution provided that the original author and source are credited. |
| spellingShingle | Medicine Aczel, Balazs Szaszi, Barnabas Nilsonne, Gustav van den Akker, Olmo R Albers, Casper J van Assen, Marcel ALM Bastiaansen, Jojanneke A Benjamin, Daniel Boehm, Udo Botvinik-Nezer, Rotem Bringmann, Laura F Busch, Niko A Caruyer, Emmanuel Cataldo, Andrea M Cowan, Nelson Delios, Andrew van Dongen, Noah NN Donkin, Chris van Doorn, Johnny B Dreber, Anna Dutilh, Gilles Egan, Gary F Gernsbacher, Morton Ann Hoekstra, Rink Hoffmann, Sabine Holzmeister, Felix Huber, Juergen Johannesson, Magnus Jonas, Kai J Kindel, Alexander T Kirchler, Michael Kunkels, Yoram K Lindsay, D Stephen Mangin, Jean-Francois Matzke, Dora Munafò, Marcus R Newell, Ben R Nosek, Brian A Poldrack, Russell A van Ravenzwaaij, Don Rieskamp, Jörg Salganik, Matthew J Sarafoglou, Alexandra Schonberg, Tom Schweinsberg, Martin Shanks, David Silberzahn, Raphael Simons, Daniel J Spellman, Barbara A St-Jean, Samuel Starns, Jeffrey J Uhlmann, Eric Luis Wicherts, Jelte Wagenmakers, Eric-Jan Consensus-based guidance for conducting and reporting multi-analyst studies |
| title | Consensus-based guidance for conducting and reporting multi-analyst studies |
| title_full | Consensus-based guidance for conducting and reporting multi-analyst studies |
| title_fullStr | Consensus-based guidance for conducting and reporting multi-analyst studies |
| title_full_unstemmed | Consensus-based guidance for conducting and reporting multi-analyst studies |
| title_short | Consensus-based guidance for conducting and reporting multi-analyst studies |
| title_sort | consensus-based guidance for conducting and reporting multi-analyst studies |
| topic | Medicine |
| url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8626083/ https://www.ncbi.nlm.nih.gov/pubmed/34751133 http://dx.doi.org/10.7554/eLife.72185 |
| work_keys_str_mv | AT aczelbalazs consensusbasedguidanceforconductingandreportingmultianalyststudies AT szaszibarnabas consensusbasedguidanceforconductingandreportingmultianalyststudies AT nilsonnegustav consensusbasedguidanceforconductingandreportingmultianalyststudies AT vandenakkerolmor consensusbasedguidanceforconductingandreportingmultianalyststudies AT alberscasperj consensusbasedguidanceforconductingandreportingmultianalyststudies AT vanassenmarcelalm consensusbasedguidanceforconductingandreportingmultianalyststudies AT bastiaansenjojannekea consensusbasedguidanceforconductingandreportingmultianalyststudies AT benjamindaniel consensusbasedguidanceforconductingandreportingmultianalyststudies AT boehmudo consensusbasedguidanceforconductingandreportingmultianalyststudies AT botviniknezerrotem consensusbasedguidanceforconductingandreportingmultianalyststudies AT bringmannlauraf consensusbasedguidanceforconductingandreportingmultianalyststudies AT buschnikoa consensusbasedguidanceforconductingandreportingmultianalyststudies AT caruyeremmanuel consensusbasedguidanceforconductingandreportingmultianalyststudies AT cataldoandream consensusbasedguidanceforconductingandreportingmultianalyststudies AT cowannelson consensusbasedguidanceforconductingandreportingmultianalyststudies AT deliosandrew consensusbasedguidanceforconductingandreportingmultianalyststudies AT vandongennoahnn consensusbasedguidanceforconductingandreportingmultianalyststudies AT donkinchris consensusbasedguidanceforconductingandreportingmultianalyststudies AT vandoornjohnnyb consensusbasedguidanceforconductingandreportingmultianalyststudies AT dreberanna consensusbasedguidanceforconductingandreportingmultianalyststudies AT dutilhgilles consensusbasedguidanceforconductingandreportingmultianalyststudies AT egangaryf consensusbasedguidanceforconductingandreportingmultianalyststudies AT gernsbachermortonann consensusbasedguidanceforconductingandreportingmultianalyststudies AT hoekstrarink consensusbasedguidanceforconductingandreportingmultianalyststudies AT hoffmannsabine consensusbasedguidanceforconductingandreportingmultianalyststudies AT holzmeisterfelix consensusbasedguidanceforconductingandreportingmultianalyststudies AT huberjuergen consensusbasedguidanceforconductingandreportingmultianalyststudies AT johannessonmagnus consensusbasedguidanceforconductingandreportingmultianalyststudies AT jonaskaij consensusbasedguidanceforconductingandreportingmultianalyststudies AT kindelalexandert consensusbasedguidanceforconductingandreportingmultianalyststudies AT kirchlermichael consensusbasedguidanceforconductingandreportingmultianalyststudies AT kunkelsyoramk consensusbasedguidanceforconductingandreportingmultianalyststudies AT lindsaydstephen consensusbasedguidanceforconductingandreportingmultianalyststudies AT manginjeanfrancois consensusbasedguidanceforconductingandreportingmultianalyststudies AT matzkedora consensusbasedguidanceforconductingandreportingmultianalyststudies AT munafomarcusr consensusbasedguidanceforconductingandreportingmultianalyststudies AT newellbenr consensusbasedguidanceforconductingandreportingmultianalyststudies AT nosekbriana consensusbasedguidanceforconductingandreportingmultianalyststudies AT poldrackrussella consensusbasedguidanceforconductingandreportingmultianalyststudies AT vanravenzwaaijdon consensusbasedguidanceforconductingandreportingmultianalyststudies AT rieskampjorg consensusbasedguidanceforconductingandreportingmultianalyststudies AT salganikmatthewj consensusbasedguidanceforconductingandreportingmultianalyststudies AT sarafogloualexandra consensusbasedguidanceforconductingandreportingmultianalyststudies AT schonbergtom consensusbasedguidanceforconductingandreportingmultianalyststudies AT schweinsbergmartin consensusbasedguidanceforconductingandreportingmultianalyststudies AT shanksdavid consensusbasedguidanceforconductingandreportingmultianalyststudies AT silberzahnraphael consensusbasedguidanceforconductingandreportingmultianalyststudies AT simonsdanielj consensusbasedguidanceforconductingandreportingmultianalyststudies AT spellmanbarbaraa consensusbasedguidanceforconductingandreportingmultianalyststudies AT stjeansamuel consensusbasedguidanceforconductingandreportingmultianalyststudies AT starnsjeffreyj consensusbasedguidanceforconductingandreportingmultianalyststudies AT uhlmannericluis consensusbasedguidanceforconductingandreportingmultianalyststudies AT wichertsjelte consensusbasedguidanceforconductingandreportingmultianalyststudies AT wagenmakersericjan consensusbasedguidanceforconductingandreportingmultianalyststudies |