interpreting unexpected significant.pdf (308.16 kB)
Interpreting unexpected significant findings
Many people assume that if an ANOVA output is significant at the .05 level, there's only a one in twenty chance of it being a spurious chance effect. We have been taught that we do ANOVA rather than numerous t-tests because ANOVA adjusts for multiple comparisons. But this interpretation is quite wrong. ANOVA adjusts for the number of levels within a factor, so, for instance, the probability of finding a significant effect of group is the same regardless of how many groups you have. ANOVA makes no adjustment to p-values for the number of factors and interactions in your design. The more of these you have, the greater the chance of turning up a "significant" result.
History
Usage metrics
Categories
- Statistics not elsewhere classified
- Probability theory
- Applied and developmental psychology not elsewhere classified
- Clinical psychology
- Educational psychology
- Psychophysiology
- Industrial and organisational psychology (incl. human factors)
- Behavioural neuroscience
- Forensic psychology
- Personality and individual differences
- Social psychology
- Mental health services
Keywords
Licence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC