Cargando…

What is the proper way to apply the multiple comparison test?

Multiple comparisons tests (MCTs) are performed several times on the mean of experimental conditions. When the null hypothesis is rejected in a validation, MCTs are performed when certain experimental conditions have a statistically significant mean difference or there is a specific aspect between t...

Descripción completa

Detalles Bibliográficos
Autores principales: Lee, Sangseok, Lee, Dong Kyu
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Korean Society of Anesthesiologists 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6193594/
https://www.ncbi.nlm.nih.gov/pubmed/30157585
http://dx.doi.org/10.4097/kja.d.18.00242
_version_ 1783364084927823872
author Lee, Sangseok
Lee, Dong Kyu
author_facet Lee, Sangseok
Lee, Dong Kyu
author_sort Lee, Sangseok
collection PubMed
description Multiple comparisons tests (MCTs) are performed several times on the mean of experimental conditions. When the null hypothesis is rejected in a validation, MCTs are performed when certain experimental conditions have a statistically significant mean difference or there is a specific aspect between the group means. A problem occurs if the error rate increases while multiple hypothesis tests are performed simultaneously. Consequently, in an MCT, it is necessary to control the error rate to an appropriate level. In this paper, we discuss how to test multiple hypotheses simultaneously while limiting type I error rate, which is caused by α inflation. To choose the appropriate test, we must maintain the balance between statistical power and type I error rate. If the test is too conservative, a type I error is not likely to occur. However, concurrently, the test may have insufficient power resulted in increased probability of type II error occurrence. Most researchers may hope to find the best way of adjusting the type I error rate to discriminate the real differences between observed data without wasting too much statistical power. It is expected that this paper will help researchers understand the differences between MCTs and apply them appropriately.
format Online
Article
Text
id pubmed-6193594
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Korean Society of Anesthesiologists
record_format MEDLINE/PubMed
spelling pubmed-61935942018-10-19 What is the proper way to apply the multiple comparison test? Lee, Sangseok Lee, Dong Kyu Korean J Anesthesiol Statistical Round Multiple comparisons tests (MCTs) are performed several times on the mean of experimental conditions. When the null hypothesis is rejected in a validation, MCTs are performed when certain experimental conditions have a statistically significant mean difference or there is a specific aspect between the group means. A problem occurs if the error rate increases while multiple hypothesis tests are performed simultaneously. Consequently, in an MCT, it is necessary to control the error rate to an appropriate level. In this paper, we discuss how to test multiple hypotheses simultaneously while limiting type I error rate, which is caused by α inflation. To choose the appropriate test, we must maintain the balance between statistical power and type I error rate. If the test is too conservative, a type I error is not likely to occur. However, concurrently, the test may have insufficient power resulted in increased probability of type II error occurrence. Most researchers may hope to find the best way of adjusting the type I error rate to discriminate the real differences between observed data without wasting too much statistical power. It is expected that this paper will help researchers understand the differences between MCTs and apply them appropriately. Korean Society of Anesthesiologists 2018-10 2018-08-28 /pmc/articles/PMC6193594/ /pubmed/30157585 http://dx.doi.org/10.4097/kja.d.18.00242 Text en Copyright © The Korean Society of Anesthesiologists, 2018 This is an open-access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Statistical Round
Lee, Sangseok
Lee, Dong Kyu
What is the proper way to apply the multiple comparison test?
title What is the proper way to apply the multiple comparison test?
title_full What is the proper way to apply the multiple comparison test?
title_fullStr What is the proper way to apply the multiple comparison test?
title_full_unstemmed What is the proper way to apply the multiple comparison test?
title_short What is the proper way to apply the multiple comparison test?
title_sort what is the proper way to apply the multiple comparison test?
topic Statistical Round
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6193594/
https://www.ncbi.nlm.nih.gov/pubmed/30157585
http://dx.doi.org/10.4097/kja.d.18.00242
work_keys_str_mv AT leesangseok whatistheproperwaytoapplythemultiplecomparisontest
AT leedongkyu whatistheproperwaytoapplythemultiplecomparisontest