Tests for Means, Variances & Proportions
Key Takeaways
- Match the test to the data story: t-tests for means (one-sample, two-sample, or paired), F-test for equality of two variances, ANOVA for means of three or more groups, and chi-square for categorical counts or proportions.
- A paired-comparison t-test uses differences on matched pairs (before/after on the same unit, left/right, same operator on two methods) and tests whether the mean difference is zero.
- The F-test compares two sample variances (or uses ANOVA’s mean squares); unequal variance can change which two-sample mean procedure is appropriate and often points to process instability.
- One-way ANOVA tests H₀ that all group means are equal; a significant result says at least one mean differs—follow with process knowledge or multiple comparisons, not a claim that every group differs from every other.
- Chi-square tests of independence or goodness-of-fit use counts in categories; they answer association or distribution-fit questions for attribute data, not continuous mean shifts.
Tests for Means, Variances & Proportions
Quick Answer: Choose the hypothesis test from the question and data type: t-tests for continuous means (including paired differences), F-test for two variances, ANOVA for means across three or more groups, and chi-square for counts/proportions in categories—then interpret p-values with effect size and process meaning, not letters alone.
Selecting the Right Test
| Question | Typical data | Common test |
|---|---|---|
| Is the mean equal to a target μ₀? | One continuous sample | One-sample t-test |
| Do two independent groups have the same mean? | Two continuous samples | Two-sample t-test |
| Did the same units change (before/after)? | Paired continuous differences | Paired t-test |
| Are two process variances equal? | Two continuous samples | F-test for variances |
| Are means equal across 3+ groups? | Continuous Y, one categorical X | One-way ANOVA |
| Are category proportions independent / as claimed? | Counts in a table | Chi-square test |
Verify independence, measurement quality, and rough distribution assumptions. Software prints p-values; your job is correct setup and interpretation.
Tests for Means — t Family
One-sample t-test
H₀: μ = μ₀ vs Hₐ: μ ≠ μ₀ (or one-sided). Uses sample mean, s, and n. Compare a process mean to a historical standard or mid-target as a mean test (capability still needs the full distribution vs specs).
Two-sample (independent) t-test
H₀: μ₁ = μ₂ for two independent groups (Line A vs B, Supplier 1 vs 2). If variances differ substantially, avoid forcing a pooled variance (e.g., use a Welch-type procedure). Check that “group” is not confounded with time or operator.
Paired-comparison t-test
When each observation in one sample is naturally linked to one in the other, analyze the differences dᵢ:
H₀: μ_d = 0 (mean difference is zero)
Classic pairing: same part with Method 1 and Method 2; same agent before/after training; left/right on the same board. Pairing removes unit-to-unit noise, raising power for a true method effect.
Worked scenario — paired t
Ten machines timed on old and new setups. Differences (new − old): d̄ = −1.8 min, s_d = 1.5 min.
- SE ≈ 1.5 / √10 ≈ 0.47
- t ≈ −1.8 / 0.47 ≈ −3.8 (df = 9)
At α = 0.05 two-sided, |t| this large yields p well below 0.05 → reject H₀ of zero mean difference. Interpretation: average cycle time is lower on the new setup. Still judge practical significance (−1.8 min vs labor cost) and confirm stability after rollout.
Treating the same data as independent two-sample (ignoring pairing) inflates error with between-machine noise and can hide the setup effect—a common exam trap.
F-Test for Variances
F-test (two variances) compares s₁² and s₂²:
H₀: σ₁² = σ₂² vs Hₐ: not equal (or one-sided)
Statistic form: F = s₁² / s₂² (df = n₁−1, n₂−1), using the software’s ratio convention.
When it matters: choosing pooled vs unpooled t procedures; confirming a noise-reduction project cut variance; checking multi-vari hunches that one stream is wider.
Worked scenario — F-test
Shift A: n = 20, s = 2.0; Shift B: n = 18, s = 3.5.
F ≈ (3.5)² / (2.0)² = 3.06. For typical α and df, a ratio this large often gives p < 0.05 → reject equal variances. Interpretation: Shift B is more variable—investigate practices, staffing, or inputs, not only mean location.
Classical F-tests are sensitive to non-normality. Use histograms/boxplots; consider robust alternatives when outliers dominate.
ANOVA — Means of Three or More Groups
One-way ANOVA tests:
H₀: μ₁ = μ₂ = … = μₖ
Hₐ: at least one mean differs
It partitions variation into between-group and within-group mean squares; F = MS_between / MS_within. A significant F does not say which pairs differ—only that all-means-equal is untenable. Follow with plots, process knowledge, or planned comparisons.
Worked scenario — ANOVA
Four packaging lines’ seal strengths compared. ANOVA p = 0.008 at α = 0.05 → reject H₀. Boxplots show Line 3 below the others. Next: confirm Line 3 settings/maintenance—not automatically retool every line. If p = 0.40, fail to reject equal means—still check variance and practical gaps.
ANOVA assumes independent errors, similar within-group variances, and approximate residual normality; large equal samples are more robust.
Chi-Square — Proportions and Categories
Use counts, not continuous measurements.
- Goodness-of-fit: Do observed frequencies match a stated distribution?
- Independence / association (contingency table): Is defect type independent of shift? Pass/fail independent of supplier?
Statistic: χ² = Σ (O − E)² / E. Small expected counts weaken the approximation—combine categories or collect more data.
Worked scenario — chi-square
Scratch / Dent / Other by Day vs Night forms a 3×2 table; expected counts ≥ 5. χ² p = 0.03 → reject independence at α = 0.05. Interpretation: defect mix differs by shift—investigate lighting, handling, or inspection standards. This is not a t-test on percent defective unless you restructure properly (e.g., two-proportion methods with adequate n).
For simple two-proportion questions, CSSGB items may use a two-proportion z-test or χ² on a 2×2 table—same idea: small p → evidence proportions differ.
Putting Interpretation Together
| Result | Good Green Belt statement |
|---|---|
| p ≤ α, large useful effect | Reject H₀; effect size supports Improve action |
| p ≤ α, tiny effect | Statistically significant; practical impact may not justify change |
| p > α, large estimated effect, small n | Fail to reject; may be underpowered—consider more data |
| Significant ANOVA | At least one mean differs; identify which with plots/comparisons |
| Significant F / unequal s | Variability may dominate; fix spread before chasing means |
Pitfalls and Exam Focus
- Using independent two-sample t when pairing is the design.
- Running many unplanned t-tests among k groups instead of ANOVA first.
- Applying chi-square to averages without raw counts.
- Reading a significant F or ANOVA as root cause without process investigation.
- Ignoring assumptions when n is tiny or outliers dominate.
CSSGB IV.B.2 items usually present a short scenario and ask which test, what H₀ means, or what a significant result allows—ground answers in the process question, not the option letter.
Each of 12 operators assembles a unit with Method A and the same operators later assemble a comparable unit with Method B. The Green Belt wants to test whether mean assembly time differs between methods. Which procedure is most appropriate?
A one-way ANOVA comparing mean thickness for five mold cavities yields p = 0.02 at α = 0.05. Which conclusion is best?
A team builds a contingency table of Pass/Fail versus Supplier (three suppliers) using weekly lot counts. They want to know whether pass rate is associated with supplier. Which test and interpretation fit?