Page 1 of 1

correction of multiple ANOVA contrast test

Posted: Sun Aug 22, 2021 1:38 pm
by Tong
For ANOVA with post hoc multiple comparisions as well as a number of planned contrast tests, shouldn't the p values be corrected by the total number of tests for both ANOVA's post hoc test and the contasts?
right now , it seemed the ps for contrast are not corrected, and the post hoc comparisons are corrected by the number of "Post Hoc Tests"

Re: correction of multiple ANOVA contrast test

Posted: Tue Aug 24, 2021 1:47 am
by jonathon
i think what we're doing here is considered "standard", but let us know if that isn't the case.

jonathon

Re: correction of multiple ANOVA contrast test

Posted: Tue Aug 24, 2021 10:46 pm
by reason180
If, for example, you were inspecting an issue of a journal, with each article reporting between three and seven p values (a total of 40 p values), and if you wanted the probability of making a least one Type I error (in the set of 40 test) to be no greater than 0.05, you could apply the Bonferroni correction for the set of 40 tests. But it seems a bit hopeless, no?