3.3 Performance Measures: Balanced Scorecard, KPIs, KBIs, OKRs, and Line of Sight
Key Takeaways
- A key performance indicator measures an outcome; a key behavior indicator measures the human behaviour believed to drive that outcome.
- Objectives and key results pair a qualitative objective with three to five measurable key results and are set on a quarterly cadence, deliberately stretched so full attainment is not expected.
- The balanced scorecard's four perspectives are financial, customer, internal business process, and learning and growth.
- Customer loyalty metrics include Net Promoter Score, retention rate, repurchase rate, and customer lifetime value; NPS is the percentage of promoters minus the percentage of detractors.
- Line of sight means every operator-level measure can be traced upward through a documented causal chain to a strategic objective.
Four instruments, four questions
| Instrument | Question it answers | Typical cadence | Owner |
|---|---|---|---|
| Balanced scorecard | Are we healthy across all four dimensions of the business? | Monthly or quarterly | Executive team |
| KPI | Did the outcome we care about actually move? | Daily to monthly | Process owner |
| KBI | Are people doing the things that produce the outcome? | Daily to weekly | Supervisor |
| OKR | What ambitious, time-boxed shift are we attempting this quarter? | Quarterly | Objective owner |
Using one where another belongs is the common failure. An organization that tracks only KPIs learns about failure after it happens; one that tracks only KBIs measures activity and can miss that the activity is not producing the outcome.
Key performance indicators
A KPI is an outcome measure tied to a strategic or process objective. Good KPIs share five properties: they are quantitative, owned by a named person, defined operationally, collected at a frequency that supports action, and small in number. A department with 40 KPIs has no KPIs.
The most useful discipline is pairing. Any single KPI can be gamed by degrading something it does not measure, so KPIs travel in counter-balanced pairs:
| Primary KPI | Counter-balancing KPI | Behaviour it prevents |
|---|---|---|
| Units produced per shift | First-pass yield | Running through marginal conditions to hit volume |
| Average handling time | First-contact resolution | Ending calls quickly without solving the problem |
| Inventory turns | On-time in-full delivery | Starving the process of buffer and missing shipments |
| Cost per unit | Warranty claims per thousand | Cheapening inputs at the customer's expense |
Key behavior indicators
A KBI measures the observable behaviour believed to cause the outcome. Where a KPI is lagging by construction, a KBI is available immediately and is directly coachable.
Examples: percentage of shifts where the layered process audit was completed; percentage of control chart out-of-control signals with a documented reaction; percentage of gemba walks conducted as scheduled; percentage of andon pulls responded to within the target time.
KBIs matter to Black Belts because control plans live or die on behaviour. A control plan that specifies a reaction to an out-of-control point is only real if someone measures whether the reaction happens. The KBI is the sustainment measure for the control plan.
One caution: a KBI is a hypothesis. It asserts that behaviour causes outcome. If the KBI is green for three months and the KPI has not moved, the hypothesis is wrong and the KBI must change.
Objectives and key results
OKRs pair a qualitative, directional objective with three to five quantitative key results that measure whether the objective was reached.
- Objective: Make first-pass quality a competitive advantage in the moulding cell.
- KR1: Raise first-pass yield from 91.4% to 97.0%.
- KR2: Reduce scrap cost per thousand parts from $38.10 to $18.00.
- KR3: Cut mean time to detect an out-of-control condition from 46 minutes to under 10 minutes.
Three features distinguish OKRs from KPIs. They are time-boxed, normally quarterly. They are deliberately stretched, so 70% attainment is often treated as success and consistent 100% attainment signals targets set too low. And they are usually not tied to compensation, precisely so that stretch remains safe to attempt.
KPIs and OKRs coexist: KPIs are the standing health measures of a process, OKRs are the temporary focus for a period of change. A DMAIC project maps naturally onto an OKR, with the project's primary metric as KR1.
Balanced scorecard perspectives
The balanced scorecard exists because financial measures alone are lagging and incomplete. Its four perspectives, and the causal logic that links them:
| Perspective | Question | Six Sigma measures that fit |
|---|---|---|
| Financial | How do we appear to shareholders? | COPQ reduction, project savings, margin, ROI |
| Customer | How do customers see us? | NPS, retention, on-time in-full, CTQ defect rate |
| Internal business process | What must we excel at? | Cpk, DPMO, RTY, cycle time, OEE |
| Learning and growth | Can we keep improving? | Belts trained and active, control plans owned, projects per belt |
The causal chain runs upward: learning and growth enables better internal processes, which produce customer outcomes, which produce financial results. That chain is exactly what a strategy map draws, and it is the mechanism by which a Black Belt argues that a process project deserves funding.
Customer loyalty metrics
| Metric | Definition | Reading |
|---|---|---|
| Net Promoter Score | % promoters (9-10) minus % detractors (0-6) on an 11-point recommendation scale | Range -100 to +100; passives (7-8) are excluded from both terms |
| Retention rate | Customers retained over a period divided by customers at the start | Complement of churn |
| Repurchase rate | Share of customers who buy again within a defined window | Behavioural rather than attitudinal |
| Customer lifetime value | Discounted margin expected over the relationship | Converts loyalty into money for project justification |
NPS is the one most often mis-stated. It is a difference of percentages, not an average, passives are excluded from the calculation but remain in the denominator, and the result is a number between -100 and +100 rather than a percentage.
Line of sight
Line of sight means an operator can name the strategic objective their measure serves, and an executive can trace a strategic objective down to the process measures that move it. Build it in four steps:
- State the strategic objective in measurable terms.
- Identify the process outputs ($Y$s) that determine it.
- Identify the controllable process inputs ($X$s) that determine those outputs.
- Assign each $X$ a measure, an owner, a frequency, and a reaction rule.
The test of a real line of sight is a two-way conversation. Ask an operator why their measure matters; ask an executive which shop-floor measure would move first if their objective were failing. If either cannot answer, the cascade is decorative.
A survey of 400 customers returns 180 promoters, 140 passives, and 80 detractors. What is the Net Promoter Score?
A control plan requires operators to document a reaction whenever a control chart signals. Which measure best confirms that the control plan is actually being followed, as opposed to confirming that quality improved?
A team consistently achieves 100% of its quarterly key results and its leadership treats this as a sign of excellent performance. What does the OKR framework suggest instead?