8.3 Variables Sampling with ANSI/ASQ Z1.9

8.3 Variables Sampling with ANSI/ASQ Z1.9

Principles of Variables Acceptance Sampling

ANSI/ASQ Z1.9 (Sampling Procedures and Tables for Inspection by Variables for Percent Nonconforming) is the national standard governing acceptance sampling when quality characteristics are evaluated on a continuous quantitative measurement scale. It is the direct civilian successor to military standard MIL-STD-414 and is technically harmonized with international standard ISO 3951.

The Operational Concept

Unlike attribute sampling (which tallies conforming versus nonconforming parts), variables sampling measures exact quantitative values—such as a shaft outside diameter measured to the nearest $0.0001\text{ in}$, a titanium tensile specimen pulled to rupture in $\text{ksi}$, or a hardened bearing raceway tested in HRC. From these continuous sample readings ($X_1, X_2, \dots, X_n$), the quality inspector calculates two fundamental summary statistics:

1. Sample Mean ($\bar{X}$): Measures process centering relative to specification limits: $$\bar{X} = \frac{\sum_{i=1}^n X_i}{n}$$
2. Sample Standard Deviation ($s$): Measures process variability and dispersion: $$s = \sqrt{\frac{\sum_{i=1}^n (X_i - \bar{X})^2}{n - 1}}$$

By combining the sample mean, standard deviation, and engineering specification limits, the inspector calculates how far the process distribution sits from tolerance boundaries and mathematically estimates the percent of the lot that falls outside limits.

---

Variables vs. Attributes Sampling: Technical Comparison

Quality engineers and inspectors select between ANSI/ASQ Z1.4 (attributes) and ANSI/ASQ Z1.9 (variables) by weighing sample size efficiencies against gage costs and mathematical assumptions:

---

The Normality Prerequisite and Verification Techniques

The most critical rule in variables acceptance sampling is that the underlying quality characteristic must follow a normal (Gaussian) distribution.

Why Normality Is Mandatory

Variables sampling tables convert the distance between the sample mean and specification limit into an estimated tail area nonconformance percentage. This mathematical translation relies 100% on the theoretical bell curve. If the underlying process is skewed, bimodal, or flat (uniform), the estimated tail area will be wildly inaccurate. An inspector could accept a severely defective lot or reject a perfectly conforming lot because the mathematical model does not match physical reality.

Verification Methods for Inspectors

Before applying ANSI/ASQ Z1.9, quality engineering must verify normality using historical production data or sample datasets:

• Normal Probability Plots (Q-Q Plots): Individual data points are plotted against theoretical normal quantiles. If the distribution is normal, the data points fall tightly along a straight diagonal line. S-shaped curves indicate heavy tails (kurtosis), while bowed curves indicate skewness.
• Statistical Goodness-of-Fit Tests: Formal statistical tests, such as the Anderson-Darling test, Shapiro-Wilk test, or Chi-Square goodness-of-fit test, must confirm $p$-values greater than $0.05$.
• Shop Metrology Warning: Geometric tolerances that are bounded at zero—such as flatness, circularity, perpendicularity, and total runout—naturally exhibit skewed, non-normal distributions (often Chi or Weibull distributions). They cannot be directly evaluated under ANSI/ASQ Z1.9 without a mathematical transformation (e.g., Box-Cox or logarithmic) or falling back to ANSI/ASQ Z1.4 attribute sampling.

---

Structure of ANSI/ASQ Z1.9: Inspection Levels and Variability Methods

Inspection Levels

Similar to Z1.4, ANSI/ASQ Z1.9 utilizes:

• General Inspection Levels I, II, III: Level II is the standard default for general variable inspection. Level I provides smaller sample sizes; Level III provides larger sample sizes.
• Special Inspection Levels S-3, S-4: Utilized for destructive or exceptionally costly physical testing.

Variability Estimation Methods

ANSI/ASQ Z1.9 is organized into distinct sections based on how process variability is determined:

1. Section B: Standard Deviation Method ($s$-Method): Process variability is unknown and estimated using the sample standard deviation $s$. This is the most common method on modern inspection benches equipped with digital calipers, CMMs, or digital indicators.
2. Section C: Range Method ($R$-Method): Process variability is estimated using the average sample range $\bar{R}$ of sub-samples. Historically favored in machine shops before digital calculators because calculating range ($X_{\text{max}} - X_{\text{min}}$) avoided square root calculations.
3. Section D: Known Standard Deviation Method ($\sigma$-Method): Utilized when extensive historical SPC data demonstrates that process variability $\sigma$ is strictly stable and known. This method yields the absolute smallest sample sizes in the standard.

---

Single vs. Double Specification Limits and Quality Indices

Engineering blueprints establish either single or double specification limits:

• Upper Specification Limit (USL): Maximum allowable physical dimension (e.g., max diameter $0.5050\text{ in}$).
• Lower Specification Limit (LSL): Minimum allowable physical dimension (e.g., min diameter $0.4950\text{ in}$).

Calculating the Quality Index ($Q$)

The Quality Index measures the standardized distance (in sample standard deviation units) separating the sample mean from the engineering tolerance limits:

$$\text{Upper Quality Index: } Q_U = \frac{\text{USL} - \bar{X}}{s}$$ $$\text{Lower Quality Index: } Q_L = \frac{\bar{X} - \text{LSL}}{s}$$

Notice the symmetry: $Q_U$ and $Q_L$ are always formulated so that a larger positive value of $Q$ indicates that the sample mean is further inside the specification limit (indicating better quality and lower defect risk).

---

Acceptance Criteria: Form 1 vs. Form 2

ANSI/ASQ Z1.9 offers two alternative procedural formats for deciding lot disposition:

Form 1: Acceptability Constant Method ($k$-Method)

• Primarily utilized for single specification limits (USL only or LSL only).
• The inspector computes the Quality Index ($Q_U$ or $Q_L$) and compares it directly against the acceptability constant $k$ found in Table B-1 or Table B-2 of Z1.9 for the designated Code Letter and AQL:
  • For an upper specification limit: Accept lot if $Q_U \ge k$; Reject if $Q_U < k$.
  • For a lower specification limit: Accept lot if $Q_L \ge k$; Reject if $Q_L < k$.

Form 2: Maximum Allowable Percent Nonconforming Method ($M$-Method)

• Mandatory for double specification limits (both USL and LSL present), and universally applicable to single limits.
• Instead of comparing $Q$ directly to $k$, the inspector uses the calculated $Q$ values to look up the estimated percent nonconforming from Table B-5 of ANSI/ASQ Z1.9:
  1. Look up $Q_U$ in Table B-5 to determine estimated upper percent nonconforming ($p_U$).
  2. Look up $Q_L$ in Table B-5 to determine estimated lower percent nonconforming ($p_L$).
  3. Calculate total estimated percent nonconforming: $p = p_U + p_L$.
  4. Compare individual and total estimated defect percentages against the maximum allowable percent nonconforming ($M$) extracted from Master Table B-3:
     • Accept the lot if: $p_U \le M$, AND $p_L \le M$, AND $p = p_U + p_L \le M$.
     • Reject the lot if: $p > M$, or if either individual tail estimate exceeds $M$.

---

Step-by-Step Worked Shop Floor Inspection Calculation

To master variables sampling for the ASQ CQI examination, walk through a realistic CNC grinding inspection scenario:

Inspection Problem Setup

• Component: Precision ground stainless steel hydraulic spool valve.
• Characteristic: Critical spool land diameter.
• Engineering Tolerance: $1.0000\text{ in} \pm 0.0030\text{ in}$.
  • $\text{USL} = 1.0030\text{ in}$
  • $\text{LSL} = 0.9970\text{ in}$
• Lot Size ($N$): $1,500$ pieces submitted from CNC OD Grinder #4.
• Sampling Requirement: Normal Inspection Level II, $\text{AQL} = 1.5\%$, Standard Deviation ($s$) Method, Form 2 ($M$-Method).

Step 1: Determine Code Letter, Sample Size, and Acceptance Criteria

1. Consult ANSI/ASQ Z1.9 Table A-2 (Sample Size Code Letters):
   • For Lot Size $N = 1,500$ under General Inspection Level II, the Sample Size Code Letter is J.
2. Consult Master Table B-3 (Single Sampling Plans for Normal Inspection):
   • For Code Letter J, the required sample size is $n = 35$.
   • For $\text{AQL} = 1.5\%$, the maximum allowable percent nonconforming is $M = 3.32\%$.

Step 2: Perform Measurements and Calculate Sample Statistics

The inspector randomly draws $n = 35$ spools from the lot and measures each land diameter on an optical micrometer calibrated to $0.00005\text{ in}$. The computed sample statistics are:

• $\sum X = 35.0630\text{ in} \implies \bar{X} = \frac{35.0630}{35} = 1.0018\text{ in}$
• $\sum (X - \bar{X})^2 = 0.00001224 \implies s = \sqrt{\frac{0.00001224}{34}} = 0.00060\text{ in}$

Step 3: Compute Upper and Lower Quality Indices ($Q_U$ and $Q_L$)

$$\text{Upper Quality Index: } Q_U = \frac{\text{USL} - \bar{X}}{s} = \frac{1.0030 - 1.0018}{0.00060} = \frac{0.0012}{0.00060} = 2.00$$ $$\text{Lower Quality Index: } Q_L = \frac{\bar{X} - \text{LSL}}{s} = \frac{1.0018 - 0.9970}{0.00060} = \frac{0.0048}{0.00060} = 8.00$$

Step 4: Look Up Estimated Percent Nonconforming in Table B-5

Consult Table B-5 (Table for Estimating the Percent Nonconforming Using Standard Deviation Method) for $n = 35$:

• For $Q_U = 2.00$: The table yields an estimated upper tail nonconformance of $p_U = 1.62\%$.
• For $Q_L = 8.00$: Because the mean is 8 standard deviations above LSL, the lower tail nonconformance is essentially zero: $p_L = 0.00\%$.
• Calculate total estimated percent nonconforming: $$p = p_U + p_L = 1.62\% + 0.00\% = 1.62\%$$

Step 5: Adjudicate Lot Disposition

Compare estimated defect percentages against $M = 3.32\%$:

• $p_U = 1.62\% \le 3.32\%$ (Upper tail satisfies requirement)
• $p_L = 0.00\% \le 3.32\%$ (Lower tail satisfies requirement)
• $p_{\text{total}} = 1.62\% \le 3.32\%$ (Total satisfies requirement)

Disposition Decision: ACCEPT THE LOT. Even though the sample mean was shifted upward toward USL ($1.0018\text{ in}$ vs nominal $1.0000\text{ in}$), the tight process standard deviation ($0.00060\text{ in}$) kept total estimated nonconformance ($1.62\%$) well below the permissible $M$ limit ($3.32\%$).

---

Real Shop Inspection Scenarios & Common Exam Traps

• Exam Trap: Confusing Form 1 and Form 2 Decision Directions: In Form 1 ($k$-method), larger $Q$ is better: the lot is accepted if $Q \ge k$. In Form 2 ($M$-method), smaller $p$ is better: the lot is accepted if $p \le M$. Novices frequently invert these inequalities on certification exams.
• Exam Trap: Assuming All Physical Features Can Use Z1.9: A candidate may assume that any feature dimensioned on a print can use variables sampling. Remember: Z1.9 requires a normal distribution and continuous variables. Visual defect counts, thread go/no-go checks, solder bridge inspections, and un-transformed geometric tolerances (runout, flatness) cannot use Z1.9.
• Exam Trap: Failing to Check Individual Tails in Double Limits: Under Form 2 for double limits, satisfying $p_{\text{total}} \le M$ is not enough! Both individual tails must also satisfy $p_U \le M$ and $p_L \le M$. While mathematically $p_U + p_L \le M$ usually implies each is $\le M$, specific table adjustments for asymmetric tolerances require verifying individual tails.