Multiplicity control, school uniforms, and other perplexing debates.
Date
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Researchers in psychology are frequently confronted with the issue of analyzing multiple relationships simultaneously. For example, this could involve multiple outcome variables or multiple predictors in a regression framework. Current recommendations typically steer researchers toward familywise or false discovery rate Type I error control in order to limit the probability of incorrectly rejecting the null hypothesis. Stepwise modified-Bonferroni procedures are suggested for following this recommendation. However, longstanding arguments against multiplicity control, combined with a modern distaste for null hypothesis significance testing, have warranted revisiting this debate. This paper explores both sides of the multiplicity control debate with the goal of educating concerned parties regarding best practices for conducting multiple related tests.