Cargando…
Statistical simulations show that scientists need not increase overall sample size by default when including both sexes in in vivo studies
In recent years, there has been a strong drive to improve the inclusion of animals of both sexes in the design of in vivo research studies, driven by a need to increase sex representation in fundamental biology and drug development. This has resulted in inclusion mandates by funding bodies and journ...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10284409/ https://www.ncbi.nlm.nih.gov/pubmed/37289836 http://dx.doi.org/10.1371/journal.pbio.3002129 |
_version_ | 1785061395542310912 |
---|---|
author | Phillips, Benjamin Haschler, Timo N. Karp, Natasha A. |
author_facet | Phillips, Benjamin Haschler, Timo N. Karp, Natasha A. |
author_sort | Phillips, Benjamin |
collection | PubMed |
description | In recent years, there has been a strong drive to improve the inclusion of animals of both sexes in the design of in vivo research studies, driven by a need to increase sex representation in fundamental biology and drug development. This has resulted in inclusion mandates by funding bodies and journals, alongside numerous published manuscripts highlighting the issue and providing guidance to scientists. However, progress is slow and barriers to the routine use of both sexes remain. A frequent, major concern is the perceived need for a higher overall sample size to achieve an equivalent level of statistical power, which would result in an increased ethical and resource burden. This perception arises from either the belief that sex inclusion will increase variability in the data (either through a baseline difference or a treatment effect that depends on sex), thus reducing the sensitivity of statistical tests, or from misapprehensions about the correct way to analyse the data, including disaggregation or pooling by sex. Here, we conduct an in-depth examination of the consequences of including both sexes on statistical power. We performed simulations by constructing artificial datasets that encompass a range of outcomes that may occur in studies studying a treatment effect in the context of both sexes. This includes both baseline sex differences and situations in which the size of the treatment effect depends on sex in both the same and opposite directions. The data were then analysed using either a factorial analysis approach, which is appropriate for the design, or a t test approach following pooling or disaggregation of the data, which are common but erroneous strategies. The results demonstrate that there is no loss of power to detect treatment effects when splitting the sample size across sexes in most scenarios, providing that the data are analysed using an appropriate factorial analysis method (e.g., two-way ANOVA). In the rare situations where power is lost, the benefit of understanding the role of sex outweighs the power considerations. Additionally, use of the inappropriate analysis pipelines results in a loss of statistical power. Therefore, we recommend analysing data collected from both sexes using factorial analysis and splitting the sample size across male and female mice as a standard strategy. |
format | Online Article Text |
id | pubmed-10284409 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-102844092023-06-22 Statistical simulations show that scientists need not increase overall sample size by default when including both sexes in in vivo studies Phillips, Benjamin Haschler, Timo N. Karp, Natasha A. PLoS Biol Meta-Research Article In recent years, there has been a strong drive to improve the inclusion of animals of both sexes in the design of in vivo research studies, driven by a need to increase sex representation in fundamental biology and drug development. This has resulted in inclusion mandates by funding bodies and journals, alongside numerous published manuscripts highlighting the issue and providing guidance to scientists. However, progress is slow and barriers to the routine use of both sexes remain. A frequent, major concern is the perceived need for a higher overall sample size to achieve an equivalent level of statistical power, which would result in an increased ethical and resource burden. This perception arises from either the belief that sex inclusion will increase variability in the data (either through a baseline difference or a treatment effect that depends on sex), thus reducing the sensitivity of statistical tests, or from misapprehensions about the correct way to analyse the data, including disaggregation or pooling by sex. Here, we conduct an in-depth examination of the consequences of including both sexes on statistical power. We performed simulations by constructing artificial datasets that encompass a range of outcomes that may occur in studies studying a treatment effect in the context of both sexes. This includes both baseline sex differences and situations in which the size of the treatment effect depends on sex in both the same and opposite directions. The data were then analysed using either a factorial analysis approach, which is appropriate for the design, or a t test approach following pooling or disaggregation of the data, which are common but erroneous strategies. The results demonstrate that there is no loss of power to detect treatment effects when splitting the sample size across sexes in most scenarios, providing that the data are analysed using an appropriate factorial analysis method (e.g., two-way ANOVA). In the rare situations where power is lost, the benefit of understanding the role of sex outweighs the power considerations. Additionally, use of the inappropriate analysis pipelines results in a loss of statistical power. Therefore, we recommend analysing data collected from both sexes using factorial analysis and splitting the sample size across male and female mice as a standard strategy. Public Library of Science 2023-06-08 /pmc/articles/PMC10284409/ /pubmed/37289836 http://dx.doi.org/10.1371/journal.pbio.3002129 Text en © 2023 Phillips et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Meta-Research Article Phillips, Benjamin Haschler, Timo N. Karp, Natasha A. Statistical simulations show that scientists need not increase overall sample size by default when including both sexes in in vivo studies |
title | Statistical simulations show that scientists need not increase overall sample size by default when including both sexes in in vivo studies |
title_full | Statistical simulations show that scientists need not increase overall sample size by default when including both sexes in in vivo studies |
title_fullStr | Statistical simulations show that scientists need not increase overall sample size by default when including both sexes in in vivo studies |
title_full_unstemmed | Statistical simulations show that scientists need not increase overall sample size by default when including both sexes in in vivo studies |
title_short | Statistical simulations show that scientists need not increase overall sample size by default when including both sexes in in vivo studies |
title_sort | statistical simulations show that scientists need not increase overall sample size by default when including both sexes in in vivo studies |
topic | Meta-Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10284409/ https://www.ncbi.nlm.nih.gov/pubmed/37289836 http://dx.doi.org/10.1371/journal.pbio.3002129 |
work_keys_str_mv | AT phillipsbenjamin statisticalsimulationsshowthatscientistsneednotincreaseoverallsamplesizebydefaultwhenincludingbothsexesininvivostudies AT haschlertimon statisticalsimulationsshowthatscientistsneednotincreaseoverallsamplesizebydefaultwhenincludingbothsexesininvivostudies AT karpnatashaa statisticalsimulationsshowthatscientistsneednotincreaseoverallsamplesizebydefaultwhenincludingbothsexesininvivostudies |