6.2 The Three Es: Economy, Efficiency & Effectiveness
Key Takeaways
The Three Es form the conceptual foundation of performance auditing: Economy minimizes input costs while preserving quality; Efficiency maximizes outputs from given inputs; Effectiveness ensures outputs achieve intended outcomes and impacts.
The Public Intervention Logic Model traces public resources through five sequential stages: Inputs, Processes, Outputs, Outcomes, and Impacts, providing the framework for performance evaluation.
Depending on mandate and criteria, performance work may also examine additional lenses such as to incorporate Environmental Sustainability (eco-efficiency and 'do no significant harm') and Equity (fairness, accessibility, and regional cohesion).
Robust performance assessment requires setting baseline data, credible targets, and key performance indicators (KPIs) complying with RACER criteria (Relevant, Accepted, Credible, Easy to monitor, Robust).
Auditors must isolate the true net effect of public interventions by evaluating counterfactuals and accounting for deadweight, displacement/substitution effects, and unintended negative externalities.
6.2 The Three Es: Economy, Efficiency & Effectiveness
Core Principle: In public sector performance auditing, value for money is evaluated through the interconnected tripartite model of Economy, Efficiency, and Effectiveness—collectively known as the Three Es. An intervention that is economical but inefficient is wasteful; an intervention that is efficient but ineffective delivers the wrong results quickly. The auditor must examine the entire chain of public intervention to verify sound financial management.
1. Deep Conceptual Analysis of the Three Es
The Three Es are defined under ISSAI 300 and Article 33 of the EU Financial Regulation (Regulation 2024/2509) as follows:
Economy (Inputs at Lowest Cost with Appropriate Quality)
Economy means minimizing the cost of resources used for an activity, having regard to the appropriate quality.
- Focus: The input side of the equation.
- Operational Standard: Resources (financial appropriations, human staff, technical supplies, IT equipment) must be made available in a timely manner, in appropriate quantity and quality, and at the lowest possible cost.
- Critical Caveat: Economy does not simply mean buying the cheapest available goods or services. Procuring low-grade concrete that cracks after three years or hiring underqualified consultants to save initial fees represents a false economy that compromises subsequent efficiency and effectiveness. Quality specifications must be maintained while eliminating unnecessary expenditures.
Efficiency (Input-to-Output Ratio & Productivity)
Efficiency means obtaining the best relationship between the resources employed and the outputs achieved.
- Focus: The relationship between inputs and outputs (the production or transformation function).
- Two Operational Perspectives:
- Output Maximization: Getting the maximum quantity and quality of outputs from a given level of resource inputs.
- Input Minimization: Utilizing the minimum quantity of resource inputs to deliver a predetermined quantity and quality of output.
- Key Metrics: Productivity ratios, unit costs (such as cost per kilometer of rail track constructed or cost per processing of a grant application), processing turnaround times, and error rates during operational execution.
Effectiveness (Outputs to Outcomes & Impacts)
Effectiveness means the extent to which the objectives pursued by an activity are attained, representing the relationship between the intended impact and the actual impact of an activity.
- Focus: The achievement of stated policy goals and the delivery of positive changes for beneficiaries and society.
- Distinction from Efficiency: An administrative agency might operate with outstanding efficiency—processing 10,000 agricultural training certificates per month at minimal unit cost—yet remain entirely ineffective if the training fails to improve sustainable farming techniques or farm incomes.
Additional Analytical Lenses Beyond the Three Es
In contemporary EU and international public management, the Three Es are complemented by two vital horizontal dimensions:
- Environmental Sustainability (The Green Dimension): Evaluating whether public spending respects climate and environmental mandates. In EU spending, this is operationalized through eco-efficiency (minimizing environmental degradation per unit of economic output) and the binding "Do No Significant Harm" (DNSH) principle under the Recovery and Resilience Facility (RRF).
- Equity (The Fairness Dimension): Examining whether public resources and benefits are distributed fairly across geographical regions (territorial cohesion), socioeconomic groups, genders, and demographic cohorts, ensuring accessibility for vulnerable populations.
2. The Public Intervention Logic Model
To systematically analyze public policies and spending programmes, performance auditors utilize the Public Intervention Logic Model. This model traces public resources through five sequential stages:
+----------+ +-------------+ +-----------+ +------------+ +-----------+
| INPUTS | ----> | PROCESSES | ----> | OUTPUTS | ----> | OUTCOMES | ----> | IMPACTS |
+----------+ +-------------+ +-----------+ +------------+ +-----------+
| | | | |
\--------------------/ | | |
ECONOMY | | |
| | | |
\------------------------------/ | |
EFFICIENCY | |
| | |
\--------------------------------------------------------/
EFFECTIVENESS
The Five Stages of the Logic Model
- Inputs: The financial, human, material, and intellectual resources allocated to an activity (for example, EUR 500 million in EU structural funds and 40 dedicated project managers).
- Processes / Activities: The operational tasks, procurement procedures, IT developments, and administrative actions that transform inputs into deliverables (for example, publishing tender notices, evaluating bids, and managing works contracts).
- Outputs: The immediate, tangible, and physical deliverables produced by the intervention (for example, 120 kilometers of upgraded high-speed railway, 5 modern passenger terminals, and 30 safety signal systems installed).
- Outcomes: The short- to medium-term socioeconomic or behavioral changes experienced by direct beneficiaries (for example, a 45-minute reduction in passenger transit time, a 25% increase in passenger rail ridership, and a 15% reduction in highway congestion along the corridor).
- Impacts: The long-term, overarching societal or macroeconomic transformations resulting from the cumulative outcomes (for example, regional GDP expansion, substantial reduction in greenhouse gas emissions from transport, and enhanced territorial integration).
| Logic Model Stage | Performance Dimension | Primary Evaluative Question | Illustrative Example: Clean Energy Subsidy |
|---|---|---|---|
| Inputs | Economy | Were technical components procured at competitive market prices without sacrificing quality? | Solar panels purchased at prevailing wholesale benchmark prices with Tier-1 warranties |
| Processes | Efficiency | How streamlined and cost-effective was the grant approval and disbursement process? | Application-to-disbursement processing completed within 30 days at low administrative overhead |
| Outputs | Efficiency | What physical deliverables were constructed or completed per euro spent? | 5,000 household rooftop photovoltaic installations commissioned |
| Outcomes | Effectiveness | Did beneficiary behavior change, and were immediate target results achieved? | 25 gigawatt-hours of clean electricity generated; household grid energy bills reduced by 35% |
| Impacts | Effectiveness | Did the intervention contribute to overarching multiannual policy goals? | Regional carbon emissions reduced by 1.2%; long-term green technology employment expanded |
3. Performance Measurement: Indicators, Baselines, and Targets
Performance auditing requires objective standards against which progress can be measured. When assessing management systems, auditors evaluate whether the audited body has designed an effective measurement architecture:
Key Performance Indicators (KPIs) and the RACER Framework
Under the European Commission's Better Regulation Guidelines, high-quality performance indicators must satisfy the RACER criteria:
- Relevant: Directly and logically linked to the specific policy objective being evaluated.
- Accepted: Understood, recognized, and accepted by operational staff, beneficiaries, and stakeholders.
- Credible: Unambiguous, transparent, resistant to subjective manipulation, and easily verifiable by external auditors.
- Easy to Monitor: Measurable at a proportionate cost without imposing excessive administrative burden on reporting entities.
- Robust: Methodologically sound, stable over time, and insensitive to optical gaming or distortion.
Baselines, Milestones, and Targets
- Baseline: The verified initial state of affairs prior to the public intervention (for example, regional broadband coverage standing at 42% in 2021). Without an accurate baseline, measuring progress is impossible.
- Milestones: Intermediate operational steps or qualitative checkpoints tracking execution along the timeline.
- Targets: The quantified outcome or impact to be achieved by a specific deadline (for example, achieving 95% broadband coverage by 2027).
The Problem of Target Gaming (Goodhart's Law)
Auditors must maintain vigilance against target gaming, encapsulated by Goodhart's Law: "When a measure becomes a target, it ceases to be a good measure." Public managers under intense pressure to demonstrate 100% target fulfillment may engage in:
- Cream-skimming (Cherry-picking): Selecting only the easiest, most capable beneficiaries (such as subsidizing profitable corporations rather than struggling startups) to ensure rapid target achievement.
- Milestone dilution: Defining vague qualitative milestones that can be formally "completed" on paper without delivering operational value.
4. Counterfactuals, Deadweight, and Displacement Effects
A critical challenge in performance auditing is determining causality: did the EU intervention actually cause the observed improvement, or would the improvement have happened anyway?
The Counterfactual Scenario
The counterfactual represents what would have occurred in the absence of the public intervention. To evaluate true effectiveness, auditors compare the observed reality against this counterfactual baseline.
Performance
^ [Observed Result with EU Subsidy]
| /
| / [Gross Effect]
| /
| [Counterfactual Baseline: What would have occurred anyway]
| /
| / [Deadweight Effect]
| /
+------------------------------------------+------------------------------------ Time
Policy Intervention Launched
Deadweight Effect (Effet d'Aubaine / Free-Rider Effect)
Deadweight occurs when public funds finance an activity that the beneficiary would have undertaken anyway using private commercial resources or existing budget allocations, without any change in behavior.
- Example: An EU innovation grant provides EUR 2 million to a highly profitable multinational pharmaceutical firm to develop a new diagnostic tool. If the firm's internal investment plans already committed commercial capital to develop that exact tool, the EU subsidy represents 100% deadweight. The public funds generated zero additionality.
Displacement and Substitution Effects
- Displacement Effect: Occurs when the benefits generated by an intervention in one target area come at the direct expense of a non-subsidized area, resulting in no net societal gain (for example, providing capital subsidies to attract manufacturing plants to Region A, causing existing factories in neighboring Region B to shut down and relocate).
- Substitution Effect: Occurs when a subsidized beneficiary replaces a non-subsidized worker or product with a subsidized equivalent without expanding overall output (for example, hiring subsidized apprentices while laying off experienced full-time staff).
5. Practical EU Spending Policy Case Studies
Case Study 1: Hypothetical Transport Infrastructure Programme
Assume a constructed case in which a cross-border rail programme has substantial delays, cost escalation and lower-than-planned passenger use. Economy work would examine procurement prices and cost control; efficiency work would compare resources with completed infrastructure and delivery time; effectiveness work would test whether the intervention produced the intended connectivity and modal-shift outcomes. The figures are illustrative and are not attributed to an ECA report.
Case Study 2:
Case Study 2: Hypothetical Agricultural Support Comparison
Assume two illustrative schemes: one pays on standard eligibility criteria, while another pays for verified environmental practices. Economy examines administrative and compliance cost for the quality obtained. Efficiency compares resources with hectares or beneficiaries correctly served. Effectiveness examines whether the interventions produce the intended income, land-management or environmental change, accounting for deadweight and external factors. Any numerical values used in practice should come from the supplied case evidence.
Which of the following audit findings represents a clear deficiency in economy rather than efficiency or effectiveness?
An EU grant program funded 1,000 traineeships, but none of the graduates secured permanent employment within twelve months
An IT system processing border entry permits required fifteen minutes per application instead of the planned two-minute benchmark
An environmental subsidy failed to reduce industrial carbon emissions because factories relocated across the national border
A public agency procured standard office laptops at 40% above prevailing retail market prices without securing any superior technical specifications or warranties
Within the public intervention logic model, which statement accurately distinguishes an 'outcome' from an 'output'?
Outputs measure long-term macroeconomic GDP growth, whereas outcomes measure raw financial expenditures
Outputs represent the administrative internal controls, whereas outcomes represent the cash disbursements
Outputs are the direct physical or service deliverables produced by an intervention, whereas outcomes are the medium-term socioeconomic effects and behavioral changes experienced by target beneficiaries
Outputs are qualitative policy intentions, whereas outcomes are legal compliance certifications
What phenomenon is an auditor observing when an EU industrial modernization subsidy is granted to a major manufacturer that would have purchased and installed the exact same manufacturing robots using private commercial financing without any public support?
Substitution effect
Deadweight effect (free-rider effect)
Spillover externality
Economies of scale
In evaluating the administrative performance of an EU agency processing regional development grants, which indicator directly measures operational 'efficiency'?
The average administrative cost and staff hours expended per approved grant application
The percentage of grant recipients who expressed high satisfaction with regional cultural life
The long-term reduction in regional unemployment over a ten-year economic cycle
The statutory compliance rate with European Parliament budgetary discharge guidelines
Sections you finish are checked off in the contents.