Cargando…

A Robust Effect Size Index

Effect size indices are useful tools in study design and reporting because they are unitless measures of association strength that do not depend on sample size. Existing effect size indices are developed for particular parametric models or population parameters. Here, we propose a robust effect size...

Descripción completa

Detalles Bibliográficos
Autores principales: Vandekar, Simon, Tao, Ran, Blume, Jeffrey
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7186256/
https://www.ncbi.nlm.nih.gov/pubmed/32232646
http://dx.doi.org/10.1007/s11336-020-09698-2
_version_ 1783526909537157120
author Vandekar, Simon
Tao, Ran
Blume, Jeffrey
author_facet Vandekar, Simon
Tao, Ran
Blume, Jeffrey
author_sort Vandekar, Simon
collection PubMed
description Effect size indices are useful tools in study design and reporting because they are unitless measures of association strength that do not depend on sample size. Existing effect size indices are developed for particular parametric models or population parameters. Here, we propose a robust effect size index based on M-estimators. This approach yields an index that is very generalizable because it is unitless across a wide range of models. We demonstrate that the new index is a function of Cohen’s d, [Formula: see text] , and standardized log odds ratio when each of the parametric models is correctly specified. We show that existing effect size estimators are biased when the parametric models are incorrect (e.g., under unknown heteroskedasticity). We provide simple formulas to compute power and sample size and use simulations to assess the bias and standard error of the effect size estimator in finite samples. Because the new index is invariant across models, it has the potential to make communication and comprehension of effect size uniform across the behavioral sciences.
format Online
Article
Text
id pubmed-7186256
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-71862562020-04-30 A Robust Effect Size Index Vandekar, Simon Tao, Ran Blume, Jeffrey Psychometrika Theory and Methods Effect size indices are useful tools in study design and reporting because they are unitless measures of association strength that do not depend on sample size. Existing effect size indices are developed for particular parametric models or population parameters. Here, we propose a robust effect size index based on M-estimators. This approach yields an index that is very generalizable because it is unitless across a wide range of models. We demonstrate that the new index is a function of Cohen’s d, [Formula: see text] , and standardized log odds ratio when each of the parametric models is correctly specified. We show that existing effect size estimators are biased when the parametric models are incorrect (e.g., under unknown heteroskedasticity). We provide simple formulas to compute power and sample size and use simulations to assess the bias and standard error of the effect size estimator in finite samples. Because the new index is invariant across models, it has the potential to make communication and comprehension of effect size uniform across the behavioral sciences. Springer US 2020-03-30 2020 /pmc/articles/PMC7186256/ /pubmed/32232646 http://dx.doi.org/10.1007/s11336-020-09698-2 Text en © The Author(s) 2020 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Theory and Methods
Vandekar, Simon
Tao, Ran
Blume, Jeffrey
A Robust Effect Size Index
title A Robust Effect Size Index
title_full A Robust Effect Size Index
title_fullStr A Robust Effect Size Index
title_full_unstemmed A Robust Effect Size Index
title_short A Robust Effect Size Index
title_sort robust effect size index
topic Theory and Methods
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7186256/
https://www.ncbi.nlm.nih.gov/pubmed/32232646
http://dx.doi.org/10.1007/s11336-020-09698-2
work_keys_str_mv AT vandekarsimon arobusteffectsizeindex
AT taoran arobusteffectsizeindex
AT blumejeffrey arobusteffectsizeindex
AT vandekarsimon robusteffectsizeindex
AT taoran robusteffectsizeindex
AT blumejeffrey robusteffectsizeindex