11.2 Supplier Selection, Evaluation & Rating Systems

11.2 Supplier Selection, Evaluation & Rating Systems

Supplier selection and ongoing performance governance are critical to protecting an enterprise from operational disruptions, quality escapes, and warranty liabilities. Sourcing decisions cannot rely on subjective intuition or surface-level marketing claims. The ASQ CQIA Body of Knowledge outlines a rigorous, data-driven framework: defining multidimensional selection criteria, executing comprehensive quality audits, enforcing ISO 9001:2015 Clause 8.4 compliance, and maintaining quantitative scorecards and weighted-point rating systems.

---

1. Multidimensional Supplier Selection Criteria

World-class quality organizations evaluate prospective vendors across six strategic pillars before awarding production business:

+-----------------------------------------------------------------------------------------+
|                         THE SIX SOURCING SELECTION PILLARS                              |
+-----------------------------------------------------------------------------------------+
|                                                                                         |
|  1. QUALITY CAPABILITY      : Certified QMS, SPC controls, Cpk >= 1.33, GR&R < 10%      |
|  2. DELIVERY RELIABILITY    : Demonstrated OTIF %, lead times, flexible buffer capacity|
|  3. TOTAL COST / COMMERCIAL : TCO modeling, open-book cost breakdown, fair pricing      |
|  4. TECHNICAL & INNOVATION  : R&D engineering depth, CAD/CAM compatibility, test labs  |
|  5. SERVICE & RESPONSIVENESS: Rapid SCAR containment (<24-48h), 8D closure, tech support|
|  6. FINANCIAL & COMPLIANCE  : Altman Z-score, healthy liquidity, RoHS/REACH/ITAR certs  |
|                                                                                         |
+-----------------------------------------------------------------------------------------+

Detailed Breakdown of Selection Dimensions

---

2. Supplier Audits: System, Process & Product Audits

A supplier audit is an independent, systematic, and documented examination conducted by the buyer (a second-party audit) to evaluate a supplier's quality systems, manufacturing operations, and finished product integrity.

+-----------------------------------------------------------------------------------------+
|                              SUPPLIER AUDIT TAXONOMY                                    |
+-----------------------------------------------------------------------------------------+
|                                                                                         |
|  [ SYSTEM AUDIT ]      ──► Audits entire QMS against standards (ISO 9001, AS9100)       |
|                            Scope: Quality manual, document control, training, CAPA      |
|                                                                                         |
|  [ PROCESS AUDIT ]     ──► Audits a specific manufacturing line or operation (VDA 6.3)  |
|                            Scope: Machine parameters, SOP adherence, SPC, poka-yoke     |
|                                                                                         |
|  [ PRODUCT AUDIT / FAI]──► Audits physical hardware against drawings (AS9102)           |
|                            Scope: 100% dimensional ballooning, material assays, NDT     |
|                                                                                         |
+-----------------------------------------------------------------------------------------+

1. System Audits (Second-Party QMS Audits)

• Focus: High-level organizational governance and compliance of the complete Quality Management System.
• Audit Scope: Management review records, internal audit schedules, document and record control, corrective and preventive action (CAPA) systems, employee training matrices, and calibration control systems.
• Objective: Verifies that the supplier possesses a mature, self-sustaining systemic framework capable of maintaining quality over time.

2. Process Audits (Manufacturing Line Audits)

• Focus: A specific manufacturing process, machine center, or assembly line (e.g., surface mount technology PCB soldering, aluminum die-casting, heat-treating).
• Audit Scope: Operator adherence to Standard Operating Procedures (SOPs), machine setup and parameter verification (temperature, pressure, speed), calibration status of in-line sensors, execution of in-process statistical process control (SPC) charts, and functional testing of poka-yoke (mistake-proofing) sensors.
• Objective: Confirms that the specific manufacturing process is stable, capable, and controlled to prevent defect generation.

3. Product Audits & First Article Inspection (FAI)

• Focus: The physical finished item or component.
• First Article Inspection (FAI / AS9102): A comprehensive, independent verification that a supplier's production tooling, processes, and documentation yield parts conforming 100% to all engineering drawing requirements under standard production run conditions.
  • 100% Drawing Ballooning: Every dimension, geometric tolerance (GD&T), surface finish requirement, chemical composition assay, and hardness callout is assigned a unique sequential number and measured.
  • Standard Production Conditions: FAI parts must be produced using permanent production tooling, at full production line speed, by regular line operators (never hand-made prototypes).
  • Triggers for Re-FAI: Introduction of new tooling, major drawing revisions (form, fit, or function changes), relocation of machinery to a new plant, changes in sub-tier raw material suppliers, or a production hiatus exceeding 12–24 months.

+-----------------------------------------------------------------------------------------+
|                        SUPPLIER QUALIFICATION PROGRESSION                               |
+-----------------------------------------------------------------------------------------+
|                                                                                         |
|  [ 1. Pre-Award Desk Survey ] ──► Questionnaire: QMS certs, machinery lists, financials |
|                │                                                                        |
|                ▼                                                                        |
|  [ 2. On-Site System Audit ]  ──► 2nd-party audit of facility QMS & quality procedures   |
|                │                                                                        |
|                ▼                                                                        |
|  [ 3. On-Site Process Audit ] ──► Deep-dive audit of specific manufacturing line / SPC  |
|                │                                                                        |
|                ▼                                                                        |
|  [ 4. First Article (FAI) ]   ──► 100% dimensional ballooning & metallurgical testing    |
|                │                                                                        |
|                ▼                                                                        |
|  [ 5. Approved Supplier List] ──► Placement on ASL; initial production order release     |
|                                                                                         |
+-----------------------------------------------------------------------------------------+

---

3. ISO 9001:2015 Clause 8.4: Control of Externally Provided Processes, Products & Services

ISO 9001:2015 Clause 8.4 establishes mandatory requirements for managing external providers (suppliers, subcontractors, and outsourced processes):

Core Mandates of Clause 8.4

1. Clause 8.4.1 (General Requirements): The organization must ensure that externally provided processes, products, and services conform to specified requirements. The organization is required to:
   • Establish and apply explicit criteria for the evaluation, selection, performance monitoring, and re-evaluation of external providers.
   • Retain documented information (records) of these evaluations and any necessary actions arising from them.
2. Clause 8.4.2 (Type and Extent of Control): The organization must take a risk-based approach to supplier oversight. Controls must consider:
   • The potential impact of the externally provided item on the organization's ability to consistently meet customer and regulatory requirements.
   • The perceived effectiveness of controls applied by the external provider.
   • Verification activities necessary to ensure requirements are met (e.g., receiving inspection, certificates of analysis, source inspection).
3. Clause 8.4.3 (Information for External Providers): Sourcing requirements must be clearly communicated to vendors before contract issuance, specifying:
   • The exact products, processes, or services to be provided, including technical drawings and revisions.
   • Approval requirements for products, methods, processes, and equipment release.
   • Competence and qualification requirements for supplier personnel.
   • The supplier's interactions with the buyer's quality management system.
   • Verification or validation activities that the buyer or its customer intends to perform at the supplier's premises.

---

4. Supplier Scorecards & Key Performance Indicators (KPIs)

Ongoing supplier performance is monitored quantitatively through Supplier Scorecards, replacing subjective perceptions with empirical metrics.

The Three Performance Measures the Body of Knowledge Names

Entry IV.C names three supplier performance measures explicitly. Know all three, because the third is the one candidates forget:

Level of service is the qualitative dimension. It is the reason a supplier with excellent PPM and delivery numbers can still be rated poorly: if they take three weeks to answer an engineering question, refuse volume changes, submit incorrect certificates, or fight every corrective action request, they impose real cost that neither the quality nor the delivery metric captures. Because it resists direct measurement, level of service is typically scored on a defined rating scale by the buyer, quality engineer, and receiving personnel who interact with the supplier, then weighted into the composite scorecard alongside the two objective measures.

Key Performance Indicators (KPIs)

1. Parts Per Million (PPM) Defect Rate

The universally recognized metric for supplier quality performance, quantifying the number of defective parts observed per one million units delivered:

$\text{PPM} = \left( \frac{\text{Total Defective Parts Found}}{\text{Total Parts Delivered}} \right) \times 1{,}000{,}000$

• Example Calculation: If a supplier delivers $150{,}000$ precision stamping parts during a quarter and quality inspectors identify $12$ nonconforming parts: $\text{PPM} = \left( \frac{12}{150{,}000} \right) \times 1{,}000{,}000 = 0.00008 \times 1{,}000{,}000 = \mathbf{80\text{ PPM}}$

2. Lot Acceptance Rate (LAR)

The percentage of delivered shipment lots accepted without rejection or return to vendor:

$\text{LAR (\%)} = \left( \frac{\text{Number of Lots Accepted}}{\text{Total Number of Lots Received}} \right) \times 100$

3. On-Time In-Full (OTIF) Percentage

The percentage of purchase orders delivered within the specified delivery window (e.g., 0 days late, no more than 2 days early) AND containing 100% of the ordered quantity (no partial or incomplete shipments):

$\text{OTIF (\%)} = \left( \frac{\text{Number of Orders Delivered On-Time and Complete}}{\text{Total Number of Purchase Orders Scheduled}} \right) \times 100$

4. SCAR Responsiveness & Closure Speed

Tracks the timeliness of supplier responses to nonconformance investigations: containment action submission within $24\text{ to }48\text{ hours}$, and full root cause 8D closure within $30\text{ calendar days}$.

---

5. Weighted-Point Rating Systems: Mathematical Worked Example

A weighted-point rating system aggregates diverse performance categories into a single composite score, allowing objective, mathematically sound supplier comparisons.

Mathematical Formulation

$\text{Composite Supplier Score} = \sum_{i=1}^{k} \left( W_i \times S_i \right)$ Where:

• $W_i = \text{Weight assigned to category } i \quad \left(\sum W_i = 1.00 \text{ or } 100%\right)$
• $S_i = \text{Normalized category performance score (0 to 100 points)}$

Comprehensive Worked Sourcing Example

A medical device manufacturer evaluates two competing precision CNC machining suppliers—Supplier Alpha and Supplier Beta—for a critical titanium implant contract. The evaluation team assigns the following category weights based on risk:

• Quality Performance (40% Weight, $W_1 = 0.40$): Target $\le 20\text{ PPM}$
• Delivery Reliability (25% Weight, $W_2 = 0.25$): Target $\ge 98%\text{ OTIF}$
• Cost Competitiveness (20% Weight, $W_3 = 0.20$): Target = Favorable Purchase Price Variance
• Technical Capability (15% Weight, $W_4 = 0.15$): Target = 5-Axis CNC & CMM capabilities

+-----------------------------------------------------------------------------------------+
|                        SUPPLIER EVALUATION PERFORMANCE DATA                             |
+-------------------------+--------+----------------------------+-------------------------+
| Performance Category    | Weight | Supplier Alpha Performance | Supplier Beta Performance|
+-------------------------+--------+----------------------------+-------------------------+
| Quality (PPM & QMS)     |  40%   | 95 pts (8 PPM, ISO 13485)  | 70 pts (180 PPM, ISO 9001|
| Delivery (OTIF %)       |  25%   | 90 pts (97.5% OTIF)        | 98 pts (99.8% OTIF)     |
| Cost Competitiveness    |  20%   | 75 pts (Higher unit price) | 95 pts (Lowest initial) |
| Technical & Engineering |  15%   | 95 pts (In-house 5-axis CMM| 80 pts (Standard 3-axis)|
+-------------------------+--------+----------------------------+-------------------------+

Step-by-Step Composite Score Calculations

Calculation for Supplier Alpha: $\text{Score}_{\text{Alpha}} = (0.40 \times 95) + (0.25 \times 90) + (0.20 \times 75) + (0.15 \times 95)$ $\text{Score}_{\text{Alpha}} = 38.0 + 22.5 + 15.0 + 14.25 = \mathbf{89.75\text{ points}}$

Calculation for Supplier Beta: $\text{Score}_{\text{Beta}} = (0.40 \times 70) + (0.25 \times 98) + (0.20 \times 95) + (0.15 \times 80)$ $\text{Score}_{\text{Beta}} = 28.0 + 24.5 + 19.0 + 12.0 = \mathbf{83.50\text{ points}}$

Strategic Sourcing Conclusion: Although Supplier Beta offered lower initial unit prices and slightly higher delivery numbers, Supplier Alpha wins the contract with a composite score of $89.75$ vs. $83.50$. In high-reliability manufacturing, Supplier Alpha's superior quality and technical depth avoid severe downstream scrap and regulatory non-compliance costs.

---

6. Supplier Performance Tiers & Governance Levels

+-----------------------------------------------------------------------------------------+
|                             SUPPLIER GOVERNANCE HIERARCHY                               |
+-----------------------------------------------------------------------------------------+
|                                                                                         |
|  [ CERTIFIED / DOCK-TO-STOCK ] (95 - 100 pts) ──► Zero receiving inspection; JIT bypass|
|                                                                                         |
|  [ PREFERRED SUPPLIER ]        (85 - 94 pts)  ──► Priority for new RFQs; multi-year pact|
|                                                                                         |
|  [ APPROVED SUPPLIER ]         (70 - 84 pts)  ──► Baseline status; standard sampling    |
|                                                                                         |
|  [ CONDITIONAL / PROBATION ]   (60 - 69 pts)  ──► 100% sorting at vendor expense; SCAR  |
|                                                                                         |
|  [ DISQUALIFIED / DE-LISTED ]  (< 60 pts)     ──► Purged from ASL; no new purchase orders|
|                                                                                         |
+-----------------------------------------------------------------------------------------+

• Certified / Dock-to-Stock (DTS): Top-tier suppliers with proven $C_{pk} \ge 1.33$, zero defects over 12+ consecutive months, and robust QMS. Shipments bypass receiving inspection straight to the line.
• Preferred Supplier: Consistently exceeds targets; receives early RFQ access, ESI invitations, and multi-year contract renewals.
• Approved Supplier: Meets minimum operational thresholds; maintained on the Approved Supplier List (ASL) subject to routine lot sampling.
• Conditional / Probationary: Underperforming vendor; placed on 100% receiving inspection paid by the vendor; executive escalation and formal corrective action plan required within 30 days.
• Disqualified / De-Listed: Failed chronic remediation; removed from ASL; barred from future quoting.