12.2 Acceptance Sampling: OC Curves, AQL, LTPD, AOQL, Z1.4/MIL-STD-105E & Dodge-Romig
Key Takeaways
Acceptance sampling is an operational lot sentencing technique (accept or reject) rather than an active defect prevention or quality control mechanism.
Deming proved acceptance sampling is economically inferior to zero inspection when incoming defect rate , and inferior to 100% inspection when (where is unit inspection cost and is unit defect damage).
The Operating Characteristic (OC) curve plots lot acceptance probability versus incoming fraction nonconforming , balancing Producer's Risk ( at AQL) and Consumer's Risk ( at LTPD).
Under rectifying inspection, Average Outgoing Quality is with peak Average Outgoing Quality Limit (AOQL), while Average Total Inspection is .
ANSI/ASQ Z1.4 attribute sampling applies dynamic switching rules (Normal, Tightened, Reduced, Discontinue) based on supplier track record to balance inspection effort with consumer protection.
12.2 Acceptance Sampling: OC Curves, AQL, LTPD, AOQL, Z1.4/MIL-STD-105E & Dodge-Romig
Acceptance sampling is a classical quality engineering methodology used to determine whether a submitted lot of incoming raw materials, fabricated components, or finished goods should be accepted or rejected based on the inspection of a representative sample. Developed at Bell Telephone Laboratories by Harold F. Dodge and Harry G. Romig beginning in the late 1920s, and adopted widely by the military during World War II, acceptance sampling remains a standard protocol for supplier qualification and receiving inspection.
1. Acceptance Sampling Philosophy
The Purpose of Sampling: Lot Sentencing vs. Process Control
A critical distinction in industrial engineering is that acceptance sampling does not control or improve quality. Acceptance sampling merely inspects the output of an existing process and sentences the lot (accept or reject). It does not alter the underlying process distribution or prevent defective units from being manufactured in the first place.
Acceptance sampling is justified under specific operational circumstances:
- When testing is destructive (e.g., tensile pull testing to fracture, explosive ordnance detonator testing, fatigue lifespan cycling).
- When the cost of 100% inspection is prohibitively high compared to the financial consequence of passing a defective item.
- When 100% manual inspection is subject to inspector fatigue, boredom, and cognitive error, leading to screening errors where inspectors miss defective units or falsely reject conforming units.
- When supplier process capability is known and stable, but formal lot-by-lot verification is contractually mandated.
Deming's Economic Perspective: The Rule
Quality pioneer W. Edwards Deming criticized traditional acceptance sampling, demonstrating that it represents an inefficient middle ground. Deming formulated an economic rule known as the Rule (or Rule):
Let:
- = Cost to inspect one unit (in $ per unit).
- = Cost incurred if a defective unit slips past inspection and enters production or reaches a customer (damage, warranty, assembly line stoppage, rework) (in $ per unit).
- = Average incoming fraction defective of the submitted lots.
Deming proved that the total cost is minimized only at the extremes:
Acceptance sampling is only economically optimal under Deming's model when hovers precisely at the breakeven threshold , or when supplier quality fluctuates unpredictably between lots.
2. Single Sampling Plans: Parameters & Mathematical Formulations
A Single Sampling Plan is fully specified by three parameters:
- = Lot size.
- = Sample size drawn at random from the lot.
- = Acceptance number (maximum allowable defective units in the sample).
Operational Decision Rule
- Draw a random sample of items from a lot of size .
- Inspect all items and count the number of defective (nonconforming) units, denoted as .
- If , Accept the entire lot.
- If , Reject the entire lot (diverting it to return, scrap, or 100% rectifying screening).
Underlying Probability Distributions
The probability of accepting a lot containing fraction nonconforming , denoted , depends on the sampling model:
1. Hypergeometric Distribution (Exact Finite Lot Model - Type A OC Curve)
When sampling without replacement from a finite lot of size containing exactly defective units:
2. Binomial Distribution (Infinite Lot / Process Stream Model - Type B OC Curve)
When sampling from a continuous manufacturing stream, or from a finite lot where the sample size is small relative to the lot ():
3. Poisson Distribution Approximation
When the sample size is large and the fraction defective is small (a common rule of thumb is with ), the binomial distribution is closely approximated by a Poisson distribution with parameter :
3. The Operating Characteristic (OC) Curve
The Operating Characteristic (OC) curve is the definitive performance signature of an acceptance sampling plan. It plots the probability of lot acceptance on the vertical axis against the incoming lot fraction defective on the horizontal axis.
Type A vs. Type B OC Curves
- Type A OC Curve: Calculated using the hypergeometric distribution to evaluate isolated, individual finite lots of size . As lot size increases for a fixed and , the Type A curve rapidly approaches the Type B curve.
- Type B OC Curve: Calculated using the binomial or Poisson distribution to evaluate lots produced by an ongoing, steady-state continuous manufacturing process.
Ideal vs. Actual OC Curves
- The Ideal OC Curve: A vertical step function that drops instantaneously from to at a defined quality threshold . Any lot with is accepted with 100% certainty; any lot with is rejected with 100% certainty. Achieving an ideal OC curve requires 100% inspection with zero inspection error.
- Actual OC Curve: A continuous, sigmoidal (S-shaped) curve. Because sampling inherently introduces random sampling error, there is always some probability of accepting bad lots or rejecting good lots.
Impact of Sample Size () and Acceptance Number ()
- Increasing with fixed : Shifts the OC curve to the left and makes it steeper, increasing the stringency and discrimination power of the plan.
- Increasing with fixed : Shifts the entire OC curve to the right, loosening acceptance criteria and raising across all values of .
- Increasing both and proportionally: Steepens the OC curve around the threshold , minimizing both producer's and consumer's risks simultaneously.
4. Key Quality Parameters: AQL, LTPD, , and
An acceptance sampling plan balances four fundamental operational parameters:
Probability
of Acceptance (Pa)
1.0 +-----------------------------------------
| * (AQL, 1 - alpha) [Producer's Point]
1 - a |---\
| \
| \
| \
| \
| \
| \
beta|----------\-------------* (LTPD, beta) [Consumer's Point]
0.0 +-----------+-------------+---------------> Incoming Fraction
AQL LTPD Defective (p)
1. Acceptable Quality Limit (AQL) & Producer's Risk ()
- Acceptance Quality Limit (AQL) (called the Acceptable Quality Level in MIL-STD-105E and older editions): The poorest quality level (maximum fraction nonconforming ) that the consumer considers satisfactory as a continuous process average. The producer expects lots of this quality to be accepted almost every time.
- Producer's Risk (): The probability that a lot of AQL quality will be mistakenly rejected by the sampling plan. This is a Type I error (rejecting a true null hypothesis ). In industrial practice, is conventionally set to (5%), meaning .
2. Lot Tolerance Percent Defective (LTPD) & Consumer's Risk ()
- Lot Tolerance Percent Defective (LTPD) (also called Rejectable Quality Level, RQL, or Limiting Quality, LQ): An unacceptable quality level () that the consumer demands be rejected almost every time.
- Consumer's Risk (): The probability that an inferior lot of LTPD quality will be mistakenly accepted by the sampling plan. This is a Type II error (failing to reject a false null hypothesis). In industrial standards, is conventionally set to (10%), meaning .
3. Discrimination Ratio / Operating Ratio ()
The ratio of LTPD to AQL measures the discriminating power of the sampling plan:
A smaller Operating Ratio indicates a steeper OC curve, providing tighter discrimination between acceptable and unacceptable lots, but requiring a significantly larger sample size .
5. Rectifying Inspection Metrics: AOQ, AOQL, and ATI
In a rectifying inspection program, rejected lots are not returned to the vendor; instead, they undergo 100% screening inspection, where all defective units are removed and replaced with conforming items. Furthermore, all defective units identified in the sample from accepted lots are also replaced with conforming units.
1. Average Outgoing Quality (AOQ)
AOQ is the expected average fraction nonconforming in the outgoing product stream after rectifying inspection. It is a function of the incoming fraction nonconforming :
- When incoming quality is pristine (), , and .
- When incoming quality is terrible (), , so virtually all lots are rejected and 100% screened, replacing all defectives with good items, hence .
- In between, the AOQ curve rises to a peak and then descends.
2. Average Outgoing Quality Limit (AOQL)
The Average Outgoing Quality Limit (AOQL) is the mathematical maximum of the AOQ curve across all possible values of incoming fraction defective :
The AOQL represents the absolute worst-case average quality level that can exit the rectifying inspection process over the long term, regardless of how poor incoming vendor quality might be.
Using the Poisson approximation for a given acceptance number , the peak occurs at a dimensionless value :
| Acceptance Number () | Peak Value | Constant | ||
|---|---|---|---|---|
| 1.000 | 0.3679 | 0.3679 | ||
| 1.618 | 0.5191 | 0.8400 | ||
| 2.269 | 0.6041 | 1.3711 | ||
| 2.945 | 0.6595 | 1.9424 |
3. Average Total Inspection (ATI)
ATI represents the average number of units inspected per lot under rectifying inspection:
- If a lot is accepted (probability ), only the sample of units is inspected.
- If a lot is rejected (probability ), all units in the lot are inspected.
- As , , and (minimum inspection cost).
- As , , and (full screening of every lot).
6. Double and Multiple Sampling Plans
A Double Sampling Plan introduces a second stage of sampling to resolve borderline cases, offering psychological benefits and reduced inspection costs for very clean or very dirty lots.
Plan Parameters
Specified by , where typically and :
- : Sample sizes for the first and second samples.
- : Acceptance number for sample 1.
- : Rejection number for sample 1.
- : Cumulative acceptance number after sample 2 ().
- : Cumulative rejection number after sample 2 ().
[ Draw Sample n1 ]
[ Count Defects d1]
|
+-----------------+-----------------+
| |
d1 <= c1 d1 >= r1
| |
[ ACCEPT ] [ REJECT ]
| |
+------------- c1 < d1 < r1 --------+
|
[ Draw Sample n2 ]
[ Count Defects d2]
|
d_total = d1 + d2
|
+---------+---------+
| |
d_total <= c2 d_total >= r2
| |
[ ACCEPT ] [ REJECT ]
Average Sample Number (ASN)
The Average Sample Number for double sampling is:
When lot quality is either exceptionally good () or exceptionally bad (), a definitive accept/reject decision is reached on the first sample . Because , a double sampling plan usually inspects fewer units on average than a single plan with a matching OC curve, although the ASN can exceed the single-plan sample size for lots near the AQL–LTPD region.
7. ANSI/ASQ Z1.4 (Attributes) and Z1.9 (Variables) Standards
The most widely recognized acceptance sampling standards in industry are ANSI/ASQ Z1.4 (inspection by attributes) and ANSI/ASQ Z1.9 (inspection by variables), which directly descend from Military Standards MIL-STD-105E and MIL-STD-414.
Inspection Levels in ANSI/ASQ Z1.4
The standard provides two tiers of inspection levels that correlate lot size with a sample size code letter:
- General Inspection Levels (I, II, III):
- Level II: The default standard for normal operations.
- Level I: Smaller samples than Level II; used when less discrimination is acceptable.
- Level III: Larger samples than Level II; used when greater discrimination is required.
- Special Inspection Levels (S-1, S-2, S-3, S-4): Utilize very small sample sizes; designated strictly for destructive testing, highly expensive test procedures, or large lots where substantial risk can be absorbed.
Dynamic Switching Rules
ANSI/ASQ Z1.4 is an adaptive system. It uses the supplier's recent quality history to switch between three operational states: Normal, Tightened, and Reduced inspection.
+-------------------------------------------------------+
| |
| [ TIGHTENED ] <====== 2 out of 5 lots rejected == [ NORMAL ]
| | |
| 5 consecutive 10 consecutive
| lots accepted lots accepted
| | |
| v v
| [ NORMAL ] <=== 1 lot rejected, irregular === [ REDUCED ]
| production, or authority
| decision
|
Z1.4: 5 lots not accepted while on Tightened
(MIL-STD-105E: 10 consecutive lots remain on Tightened)
|
v
[ DISCONTINUE INSPECTION ] (Suspend acceptance from vendor until corrective action verified)
- Normal to Tightened: Initiated when 2 out of 5 (or fewer) consecutive lots are rejected on original normal inspection. Tightened inspection keeps constant but lowers the acceptance number , steepening the OC curve to penalize the supplier.
- Tightened to Normal: Initiated when 5 consecutive lots are accepted on original tightened inspection.
- Tightened to Discontinue: Under ANSI/ASQ Z1.4-2003 and later, inspection is discontinued when the cumulative number of lots not accepted in a sequence of consecutive lots on tightened inspection reaches 5. MIL-STD-105E used a different trigger: 10 consecutive lots remaining on tightened inspection. Acceptance resumes only after the supplier corrects the problem, starting on tightened inspection.
- Normal to Reduced: Permitted when 10 consecutive lots have been accepted under normal inspection, total nonconforming items across those lots falls below standard limit tables, production is steady, and quality management approves.
- Reduced to Normal: Triggered immediately if 1 lot is rejected, production becomes irregular, or customer authority mandates return.
Attributes (Z1.4) vs. Variables (Z1.9) Comparison
| Characteristic | Attribute Sampling (ANSI/ASQ Z1.4) | Variable Sampling (ANSI/ASQ Z1.9) |
|---|---|---|
| Data Type | Qualitative (go/no-go, conforming/defective) | Quantitative continuous measurements () |
| Sample Size Required | Substantially larger () | Much smaller () for identical protection |
| Distributional Assumption | Distribution-free (Hypergeometric/Binomial) | Strictly requires normal distribution () |
| Gaging Complexity | Simple, fast limit gages (plug, snap gages) | Precise, calibrated instruments (micrometers, CMMs) |
| Multi-Characteristic Inspection | Multiple defects combined in single count | Each dimension requires separate statistical calculation |
8. Summary of Key Mathematical Formulas
| Metric | Governing Formula | Industrial Significance |
|---|---|---|
| Binomial Acceptance | Exact probability of lot acceptance for continuous streams | |
| Poisson Acceptance | Fast computational approximation when | |
| Average Outgoing Quality | Long-term average outgoing defect rate under rectifying screening | |
| AOQL (c = 1) | Absolute worst-case average outgoing defect ceiling for | |
| Average Total Inspection | Expected units inspected per lot in rectifying inspection | |
| Average Sample Number | Average inspection volume per lot in double sampling plans | |
| Operating Ratio | Quantitative measure of OC curve steepness and selectivity |
9. Dodge-Romig Tables and the MIL-STD-105E Lineage
Dodge-Romig Sampling Tables
Harold Dodge and Harry Romig published sampling tables for rectifying inspection, where rejected lots are 100% screened and defectives replaced. Their plans are consumer-oriented:
- LTPD plans guarantee a consumer's risk of 0.10 at a stated LTPD (lot tolerance percent defective). A lot that is only LTPD quality is accepted no more than 10% of the time.
- AOQL plans guarantee that average outgoing quality never exceeds a stated AOQL, whatever the incoming quality.
Within each family, the tables give single and double sampling plans indexed by lot size and process average. Among all plans that meet the protection requirement, the tabulated plan is the one that minimizes Average Total Inspection (ATI) at that process average. To use them, you need the lot size, the supplier's process average (fraction defective), and the required LTPD or AOQL. The plans apply only when rejected lots are actually screened.
MIL-STD-105E, ANSI/ASQ Z1.4, and MIL-STD-414
- MIL-STD-105E (1989) is the last edition of the military attribute sampling standard named in the NCEES specification. The Department of Defense canceled it in 1995 and adopted the civilian ANSI/ASQ Z1.4, which kept the same sample-size code letters and tables.
- ANSI/ASQ Z1.4 (and the international ISO 2859-1) is AQL-based. It protects the producer at the AQL and uses switching rules to raise protection when quality slips. The main differences from 105E are the term "Acceptance Quality Limit" and the discontinuation rule described above.
- MIL-STD-414, the variables-sampling counterpart, became ANSI/ASQ Z1.9.
| Feature | Dodge-Romig | MIL-STD-105E / Z1.4 |
|---|---|---|
| Index | LTPD or AOQL | AQL |
| Protection focus | Consumer | Producer at the AQL, with switching for consumer protection |
| Requires rectifying inspection? | Yes | No |
| Plan selection | Minimum ATI at the process average | Lot size, inspection level, and AQL lead to a code letter and plan |
A lot-by-lot rectifying inspection plan uses a sample size of n = 50 from lots of size N = 2,000 with acceptance number c = 1. If an incoming lot has a fraction defective of p = 0.02 and the probability of acceptance is P_a = 0.736, what is the Average Total Inspection (ATI) for this lot?
50 units
515 units
1,472 units
565 units
Under the ANSI/ASQ Z1.4 standard attribute sampling system, which specific operational condition mandates the transition from normal inspection to tightened inspection?
1 lot is rejected during normal inspection
2 out of 5 consecutive lots are rejected on original normal inspection
5 consecutive lots are rejected on normal inspection
10 consecutive lots fail to meet the Acceptable Quality Limit (AQL)
Sections you finish are checked off in the contents.