What Is a One-Way ANOVA?
A one-way ANOVA tests whether the means of three or more independent groups differ on a continuous outcome. One categorical factor, one continuous response, independent observations. It answers an omnibus question: is there evidence of a difference somewhere among the group means? It does not identify which groups differ — that is a post-hoc question.
Use ANOVA instead of running multiple t-tests because each additional t-test inflates the chance of at least one false positive. A single ANOVA holds the familywise error rate at the chosen α.
Hypotheses and Formula
H₀: μ₁ = μ₂ = … = μₖ (all population means are equal).
H₁: At least one population mean differs.
The F statistic compares between-group variation to within-group variation:
- SS_Between = Σ nᵢ(x̄ᵢ − x̄)²
- SS_Within = Σ Σ (xᵢⱼ − x̄ᵢ)²
- SS_Total = SS_Between + SS_Within
- df_Between = k − 1, df_Within = N − k
- MS_Between = SS_Between ÷ df_Between
- MS_Within = SS_Within ÷ df_Within
- F = MS_Between ÷ MS_Within
A large F means the group means are spread further apart than within-group noise would explain by chance. The p-value is the upper-tail probability of the F distribution with (df_Between, df_Within).
The ANOVA Table
Three rows — between groups, within groups, total — and columns for SS, df, MS, F, and p. Only the between row has an F and p. The within row provides the error term. The total row verifies that SS_Between + SS_Within equals SS_Total.
Assumptions
- Independence — observations are independent within and across groups. This is a design property and cannot be verified from the numbers alone.
- Normality — residuals within groups are approximately normal. Matters most for small samples.
- Homogeneity of variance — group variances are approximately equal. Matters most when group sizes are unequal.
- No extreme outliers — a single extreme value can distort F. Flag and investigate; never auto-remove.
A non-significant Shapiro-Wilk p-value does not prove normality. Use the Q-Q plot, box plots, and subject-matter judgement together.
Welch ANOVA
Welch's one-way ANOVA does not assume equal variances. It uses weights wᵢ = nᵢ ÷ sᵢ² and adjusts both numerator and denominator degrees of freedom. Prefer Welch when group sizes or variances differ substantially, or when Brown-Forsythe flags unequal variances. Classical F and Welch F are separate calculations — the calculator reports which one was run.
Post-Hoc Comparisons
When the omnibus test is significant, post-hoc tests identify which pairs differ. Tukey HSD (Tukey–Kramer for unequal n) controls the familywise error rate and is the standard choice after a classic ANOVA with equal variances. Games-Howell is the corresponding choice after Welch ANOVA or when variances are unequal. Bonferroni, Holm, and Šidák are alternative multiplicity adjustments.
Default pairing: classic ANOVA → Tukey; Welch ANOVA → Games-Howell. Other adjustments are available as secondary options.
Effect Sizes
- η² (eta squared) = SS_Between ÷ SS_Total. Proportion of total variance explained by the factor.
- ω² (omega squared) = (SS_Between − df_Between × MS_Within) ÷ (SS_Total + MS_Within). Less biased than η².
- Cohen's f = √(η² ÷ (1 − η²)). Conventional guidelines: ~0.10 small, ~0.25 medium, ~0.40 large. Guidelines, not laws.
Worked Example
Three groups, five observations each. Group A: 12, 15, 14, 18, 16. Group B: 21, 19, 24, 22, 20. Group C: 31, 29, 34, 32, 30.
Group means: 15, 21.2, 31.2. Grand mean: 22.47. SS_Between ≈ 665.7, SS_Within ≈ 43.2, SS_Total ≈ 708.9. df_Between = 2, df_Within = 12. MS_Between ≈ 332.9, MS_Within ≈ 3.6. F ≈ 92.5, p < 0.001. η² ≈ 0.94 — the factor explains most of the variance. Tukey HSD would flag all three pairs as significantly different.
Common Mistakes and Reporting
- Reading the omnibus F as telling you which groups differ. It does not. That is what post-hoc tests are for.
- Running multiple t-tests instead of ANOVA. This inflates the familywise error rate.
- Treating p > α as proof of equal means. It means the data did not provide sufficient evidence at the chosen α.
- Ignoring the variance assumption. If variances differ substantially, classic F is not the right test.
- Reporting p without an effect size. Statistical significance and practical magnitude are separate questions.
APA format: F(2, 12) = 92.50, p < .001, η² = .94. Report the design, group sizes, the omnibus result, effect size, and any significant post-hoc comparisons separately.