6.3 Measurement Systems & Key Performance Indicators

Measurement Systems & Key Performance Indicators

A foundational axiom of quality management, often attributed to Lord Kelvin and popularized by Peter Drucker, states: "What gets measured gets managed." However, modern quality managers recognize that measuring the wrong parameters—or measuring without strategic alignment—can actively misdirect organizational energy and degrade performance. To lead organizational excellence, CMQ/OE candidates must design measurement systems that balance financial outcomes with operational process health and employee capabilities.

---

The Balanced Scorecard (BSC) Framework

Developed by Dr. Robert Kaplan and Dr. David Norton in the early 1990s, the Balanced Scorecard (BSC) revolutionized performance measurement by complementing traditional financial metrics with non-financial operational drivers. The BSC prevents organizations from sacrificing long-term capabilities for short-term financial gains.

                         ┌─────────────────────────────┐
                         │    STRATEGY & VISION        │
                         └──────────────┬──────────────┘
                                        │
         ┌──────────────────┬───────────┴───────────┬──────────────────┐
         ▼                  ▼                       ▼                  ▼
┌─────────────────┐┌─────────────────┐    ┌─────────────────┐┌─────────────────┐
│    FINANCIAL    ││    CUSTOMER     │    │INTERNAL PROCESS ││LEARNING & GROWTH│
│ How do we look  ││ How do customers│    │ What processes  ││ How can we      │
│ to shareholders?││ view us?        │    │ must excel?     ││ improve & grow? │
└─────────────────┘└─────────────────┘    └─────────────────┘└─────────────────┘

The Four Perspectives of the Balanced Scorecard

Exam Tip: ASQ exam questions frequently ask candidates to classify metrics into the four BSC perspectives. Remember that employee training, safety culture, and organizational technology fall under Learning & Growth, while process cycle time and manufacturing scrap belong to Internal Business Processes.

---

Leading vs. Lagging Indicators

A robust measurement system must maintain a deliberate balance between lagging and leading indicators.

  Leading Indicators ──► Operational Driver ──► Lagging Indicators
  (Input/Process)                               (Outcome/Result)
  [e.g., PM Schedule Compliance]              [e.g., Equipment Failure Rate]

Lagging Indicators (Outcome Metrics)

• Definition: Measures of results after an event or operational period has concluded. They record historical performance outcomes.
• Characteristics: Highly accurate, objective, easy to measure, but reactive. By the time a lagging metric changes, the underlying operational events have already occurred.
• Examples: Quarter-end net profit, customer defect return rate, annual employee turnover count, total OSHA recordable injury rate.

Leading Indicators (Predictive Metrics)

• Definition: Measures of operational inputs, process drivers, or precursor activities that predict future outcome performance.
• Characteristics: Actionable, forward-looking, proactive, but often harder to measure or establish direct mathematical correlation with outcomes.
• Examples: Preventive maintenance schedule compliance %, employee safety audit completion %, 5S audit scores, design review completion rate.

Predictive Relationship Example

---

KPI Selection and Strategic Cascade

Metrics must not exist in isolation; they must form an unbroken chain of alignment from executive leadership down to individual front-line operators.

SMART KPI Criteria

Every KPI established within an organization should satisfy the SMART criteria:

• Specific: Clear, precise, and targeted to a single operational focus.
• Measurable: Quantifiable using reliable objective data source streams.
• Achievable: Realistic and attainable given current resources and capability.
• Relevant: Directly aligned with high-level enterprise strategic goals.
• Time-bound: Defined within a specific timeframe or reporting frequency.

The Metric Cascade Mechanism

   EXECUTIVE LEVEL
   Strategic Goal: Reduce Cost of Poor Quality (COPQ) by 15% YoY
          │
          ▼
   PLANT / DIVISION LEVEL
   Operational KPI: Increase First Pass Yield (FPY) from 91% to 97%
          │
          ▼
   DEPARTMENT / LINE LEVEL
   Process Metric: Reduce Machining Scrap Rate to < 1.5%
          │
          ▼
   OPERATOR / CELL LEVEL
   Daily Control: Complete hourly tool wear inspection & SPC charting

Through this cascading structure, a operator conducting an hourly tool inspection understands exactly how their daily compliance directly supports the enterprise goal of reducing COPQ.

---

Measurement System Integrity and Pitfalls

Even well-designed metrics can produce unintended negative behaviors if not governed properly.

Goodhart's Law & Metric Gaming

Goodhart's Law states: "When a measure becomes a target, it ceases to be a good measure."

When management attaches high-stakes rewards or punishments exclusively to a single target metric without counterbalancing controls, employees may game the system:

• Example: If a customer support center measures managers solely on Average Handle Time (AHT), agents may rush customers off the phone or hang up on complex calls to lower their average time—drastically damaging Customer Satisfaction (CSAT).
• Countermeasure: Always pair speed/volume metrics with quality/accuracy balancing metrics (e.g., pair Call Handle Time with First Contact Resolution Rate).

Measurement System Analysis (MSA)

Before relying on any metric for decision making, the measurement system itself must be validated. A Gauge Repeatability & Reproducibility (Gauge R&R) study evaluates:

• Repeatability (Equipment Variation): Variation obtained when one operator uses the same gauge to measure the same part multiple times.
• Reproducibility (Appraiser Variation): Variation obtained when different operators measure the same part using the same gauge.