19.2 Clinical Audit, Quality Improvement & Key Performance Indicators
Key Takeaways
- Clinical audit is a cyclical quality improvement process that evaluates actual clinical practice against explicit, predefined evidence-based criteria to identify deficiencies and implement targeted improvements, without requiring Research Ethics Committee (REC) approval.
- Clinical audit differs fundamentally from health research (which tests hypotheses to discover new generalizable knowledge and requires REC approval) and service evaluation (which assesses local service efficiency without judging against external standards).
- The Clinical Audit Cycle consists of five sequential stages: Stage 1 (Topic selection and standard definition), Stage 2 (Measuring baseline performance), Stage 3 (Comparing performance against criteria), Stage 4 (Implementing change), and Stage 5 (Re-auditing to close the loop and ensure sustained improvement).
- Quality improvement in Irish healthcare utilizes the Model for Improvement (three foundational questions paired with Plan-Do-Study-Act / PDSA rapid testing cycles) alongside Lean root-cause tools including process mapping, the 5 Whys, and Ishikawa (fishbone) diagrams.
- The Health Information and Quality Authority (HIQA) enforces the National Standards for Safer Better Healthcare across eight interrelated themes, driving clinical governance and monitoring National Nursing Key Performance Indicators (KPIs) such as pressure injury rates, falls with harm, CAUTI, and medication errors.
Clinical Audit, Quality Improvement & Key Performance Indicators
Core Governance Principle: Clinical audit and quality improvement (QI) are vital clinical governance mechanisms through which Registered General Nurses continuously monitor, evaluate, and elevate the standard of patient care. In Ireland, the Health Information and Quality Authority (HIQA) and the Health Service Executive (HSE) Quality and Patient Safety Directorate mandate that healthcare delivery be systematic, transparent, and accountable to national clinical standards.
Defining Clinical Audit
The National Institute for Health and Care Excellence (NICE) and the HSE define Clinical Audit as:
"A quality improvement process that seeks to improve patient care and outcomes through systematic review of care against explicit criteria and the implementation of change. Aspects of the structure, processes, and outcomes of care are selected and systematically evaluated against explicit criteria. Where indicated, changes are implemented at an individual, team, or service level and further monitoring is used to confirm improvement in healthcare delivery."
Clinical audit focuses primarily on operational adherence: it does not seek to discover whether an intervention works (which is the domain of clinical research), but rather whether healthcare practitioners are reliably delivering interventions known to be effective according to established best practice.
Clinical Audit vs. Health Research vs. Service Evaluation
A critical conceptual distinction tested in the RCSI aptitude examination is the boundary separating Clinical Audit, Health Research, and Service Evaluation. Confusing these methodologies leads to governance failures, such as conducting clinical research without ethical oversight or misapplying audit resources.
| Distinctive Feature | Clinical Audit | Health Research | Service Evaluation |
|---|---|---|---|
| Primary Objective | To assess whether current clinical practice adheres to established, explicit, evidence-based standards ("Are we following best practice?"). | To discover new clinical knowledge, test innovative hypotheses, and establish generalizable scientific truths ("What is the best practice?"). | To assess the performance, efficiency, capacity, or value of a specific local healthcare service ("How is this specific service operating?"). |
| Reference Standards | Requires explicit, predefined clinical standards (e.g., NCEC National Clinical Guidelines, HIQA standards, hospital clinical policies). | Does not compare against a predefined standard; instead, it tests an experimental intervention against a control or placebo. | Evaluates a service against local operational targets, budget constraints, or user satisfaction metrics. |
| Ethical Oversight Requirement | Does NOT require Research Ethics Committee (REC) approval; overseen by hospital Clinical Audit, Quality, or Clinical Governance committees. | MANDATORY Research Ethics Committee (REC) approval; strict adherence to ethical declarations (Declaration of Helsinki) and clinical trial regulations. | Does NOT require Research Ethics Committee (REC) approval; managed by departmental or operational clinical service leads. |
| Intervention on Patient Care | Routine clinical care is never altered, withheld, or delayed; observations reflect existing standard care. | May involve experimental protocols, random allocation, novel pharmaceutical agents, withholding interventions, or invasive sampling. | Care is delivered according to standard operating practice; no experimental treatments or control groups. |
| Generalisability of Findings | Findings are specific to the local clinical unit, ward, or hospital where the audit was conducted. | Findings are designed to be generalizable to wider regional, national, or international patient populations. | Findings are strictly confined to the local service evaluated and cannot be generalized elsewhere. |
The 5-Stage Clinical Audit Cycle
Clinical audit is not a one-off data gathering project; it is a cyclical, continuous quality improvement loop consisting of five structured stages. An audit that gathers data without re-evaluating practice after change is merely a data collection exercise, not a clinical audit.
+-----------------------------------------------------------------------------+
| THE 5-STAGE CLINICAL AUDIT CYCLE |
+-----------------------------------------------------------------------------+
| |
| STAGE 1: SELECT AUDIT TOPIC & DEFINE EXPLICIT STANDARDS |
| - High risk, high volume, high cost, or adverse incident focus |
| - Formulate measurable criteria (e.g., 100% adherence) |
| | |
| v |
| STAGE 2: MEASURE CURRENT PERFORMANCE (DATA COLLECTION) |
| - Retrospective chart review, prospective audit tool |
| - Robust sample size and GDPR-compliant data extraction |
| | |
| v |
| STAGE 3: COMPARE PERFORMANCE AGAINST STANDARDS (GAP ANALYSIS) |
| - Quantify compliance percentage and identify clinical gaps |
| - Multidisciplinary variance analysis to uncover root causes |
| | |
| v |
| STAGE 4: IMPLEMENT TARGETED PRACTICE CHANGE |
| - Develop SMART multidisciplinary action plan |
| - Staff education, process redesign, EHR decision prompts |
| | |
| v |
| STAGE 5: RE-AUDIT CLINICAL PRACTICE ("CLOSING THE LOOP") |
| - Re-measure performance using identical criteria |
| - Verify whether practice improved and whether change is sustained|
| | |
| +---> (Feeds back into Stage 1) |
+-----------------------------------------------------------------------------+
Stage 1: Topic Selection & Defining Explicit Standards
- Topic Prioritisation: Topics are selected based on high volume (e.g., peripheral venous cannula insertion), high risk (e.g., medication administration, blood transfusion verification), high cost, or areas identified as deficient by incident reports or HIQA inspections.
- Setting Standards: Standards must be derived from high-quality evidence (NCEC guidelines, NMBI standards). Criteria must be measurable and define an explicit threshold (e.g., "100% of adult patients admitted to the surgical ward must have an INEWS score calculated within 30 minutes of ward arrival").
Stage 2: Measuring Performance / Data Collection
- Design a standardized data collection tool.
- Determine whether data will be collected prospectively (observing current live practice) or retrospectively (extracting data from closed medical records).
- Ensure sample size is representative and that patient confidentiality is maintained under the General Data Protection Regulation (GDPR) and Data Protection Act 2018.
Stage 3: Comparing Performance Against Standards (Gap Analysis)
- Analyze the data to determine the percentage compliance against each audited criterion.
- Identify where clinical practice diverged from the standard (variance analysis).
- Involve the entire multidisciplinary team in discussing the results to identify the systemic, human, or logistical factors that contributed to underperformance.
Stage 4: Implementing Change
- Formulate a SMART Action Plan (Specific, Measurable, Achievable, Relevant, Time-bound).
- Assign explicit ownership for each action item to named clinical staff (e.g., Ward Sister, Practice Development Facilitator, Clinical Nurse Specialist).
- Introduce changes such as revised nursing Kardex checklists, staff training workshops, physical relocation of medical equipment, or electronic medical record (EMR) mandatory fields.
Stage 5: Re-Auditing Practice ("Closing the Loop")
- After a defined implementation window (typically 3 to 6 months), repeat data collection using the exact same methodology, audit tool, and criteria as Stage 2.
- Compare the re-audit results to the baseline data to verify whether compliance has improved significantly and whether patient safety standards are being sustained.
Quality Improvement (QI) Methodologies in Irish Healthcare
While clinical audit measures adherence to existing standards, Quality Improvement (QI) provides the scientific frameworks and tools to systematically redesign healthcare processes.
The Model for Improvement & The PDSA Cycle
Endorsed by the HSE Quality and Patient Safety Directorate and originated by the Institute for Healthcare Improvement (IHI), the Model for Improvement is built around three foundational questions followed by the Plan-Do-Study-Act (PDSA) cycle:
+-----------------------------------------------------------------------------+
| THE MODEL FOR IMPROVEMENT |
+-----------------------------------------------------------------------------+
| 1. What are we trying to accomplish? (Aim Statement: SMART goals) |
| 2. How will we know that a change is an improvement? (Measures) |
| 3. What change can we make that will result in improvement? (Change Ideas) |
+-----------------------------------------------------------------------------+
| |
| THE PDSA CYCLE |
| |
| +-------------> PLAN -------------+ |
| | - State objective | |
| | - Develop test & predictions | |
| | - Plan data collection | |
| | v |
| ACT DO |
| - Decide to adopt, adapt, - Carry out test on small scale |
| or abandon change - Document problems & observations |
| - Plan next cycle - Begin data collection |
| ^ | |
| | v |
| +------------- STUDY <------------+ |
| - Complete data analysis |
| - Compare data to predictions |
| - Summarize lessons learned |
| |
+-----------------------------------------------------------------------------+
- Small-Scale Rapid Testing: A core principle of the PDSA cycle is testing on a small scale before hospital-wide rollout (e.g., testing a new surgical pre-assessment checklist with one nurse caring for two patients on a single morning shift, rather than mandating it across all surgical wards on day one).
- The Three Types of Improvement Measures:
- Outcome Measures: Did the change achieve the ultimate patient goal? (e.g., 30% reduction in catheter-associated urinary tract infections).
- Process Measures: Were the steps in the workflow executed reliably as intended? (e.g., percentage of urinary catheters inserted using Aseptic Non-Touch Technique).
- Balancing Measures: Did the change cause unintended problems or bottlenecks in another part of the system? (e.g., did new catheter insertion documentation increase nursing overtime at end-of-shift?).
Lean & Six Sigma Root-Cause Tools
When investigating clinical bottlenecks or recurring medical errors, Irish nursing teams utilize Lean diagnostic tools:
- Process Mapping (Value Stream Mapping): Visually charting every discrete step a patient or nurse takes through a clinical pathway (e.g., from medication prescription to administration) to identify delays, redundant double-handling, and operational waste.
- The 5 Whys Technique: An iterative interrogative drill-down method to move past superficial symptoms and discover the underlying systemic defect.
- Example: Why was IV antibiotic delayed? The drug was not on the ward. Why? The pharmacy order was not sent. Why? The Kardex was in the doctors' room. Why? Medical teams take Kardexes on ward rounds without returning them. Why? No designated central Kardex docking station exists. Solution: Establish a secure ward Kardex repository and strict return policy.
- Ishikawa (Fishbone) Diagram: A graphic tool that categorizes potential causes of a clinical failure into six fundamental categories: People (staff training, fatigue), Environment (noise, poor lighting), Equipment (malfunctioning pumps), Materials (missing cannulae), Methods (ambiguous SOPs), and Measurement (inaccurate monitoring).
National Nursing Key Performance Indicators (KPIs) in Ireland
The HSE Office of the Nursing and Midwifery Services Director (ONMSD) establishes and tracks National Nursing Key Performance Indicators (KPIs) across acute and community healthcare settings. These KPIs provide quantitative benchmarks reflecting nursing care quality, patient safety, and clinical governance:
- Hospital-Acquired Pressure Injuries: Rate of newly acquired Stage 2, 3, 4, or unstageable pressure ulcers per 1,000 occupied bed days; percentage of patients having a Waterlow or Braden risk assessment documented within 6 hours of admission.
- Inpatient Falls and Falls with Harm: Number of inpatient falls per 1,000 bed days; rate of falls resulting in moderate or severe harm (fractures, intracranial injury); compliance with the national STRATIFY falls risk screening tool.
- Medication Administration Safety: Rate of medication administration omissions, wrong-dose errors, and adverse drug events; percentage compliance with independent double-checking of high-alert medications (insulin, heparin, intravenous opioids).
- Healthcare-Associated Infections (HCAIs):
- CLABSI: Central Line-Associated Bloodstream Infection rates per 1,000 central line days.
- CAUTI: Catheter-Associated Urinary Tract Infection rates; compliance with daily review of catheter necessity.
- Nursing Documentation & Clinical Handover: Percentage compliance with NMBI Recording Clinical Practice standards; audit adherence to the structured ISBAR format during shift handover and inter-ward transfers.
- Patient Experience and Engagement: Feedback metrics captured via the annual National Inpatient Experience Survey, assessing whether patients felt listened to, respected, and involved in care decisions.
Health Information and Quality Authority (HIQA)
Established under the Health Act 2007, the Health Information and Quality Authority (HIQA) is an independent statutory body charged with promoting safety and quality in healthcare and social care services in Ireland.
The National Standards for Safer Better Healthcare (NSSBH)
HIQA's regulatory inspections evaluate acute hospitals and healthcare organizations against the National Standards for Safer Better Healthcare, structured around eight interrelated themes:
+-----------------------------------------------------------------------------+
| HIQA 8 THEMES FOR SAFER BETTER HEALTHCARE |
+---------------------------------------+-------------------------------------+
| DIMENSION 1: QUALITY AND SAFETY | DIMENSION 2: CAPACITY & CAPABILITY |
| 1. Person-Centred Care | 5. Leadership, Governance & |
| 2. Effective Care | Management |
| 3. Safe Care | 6. Workforce |
| 4. Better Health and Wellbeing | 7. Use of Resources |
| | 8. Use of Information |
+---------------------------------------+-------------------------------------+
Theme Breakdown & Nursing Practice Implications
| HIQA Theme | Statutory Focus & Standard | Direct Nursing Practice Implication |
|---|---|---|
| 1. Person-Centred Care | Care is delivered with dignity, respect, and compassion; service users are informed partners in care decisions. | Ensuring patient privacy during hygiene care; facilitating communication needs (interpreters); honoring decisions under the Assisted Decision-Making (Capacity) Act 2015. |
| 2. Effective Care | Care delivery is evidence-based, guided by best practice and national clinical guidelines to maximize clinical outcomes. | Adhering strictly to NCEC National Clinical Guidelines (INEWS v2, Sepsis 6, ANTT protocols, clinical handover). |
| 3. Safe Care | Protecting patients from avoidable harm; robust clinical risk management, infection prevention, and open disclosure. | Reporting clinical near-misses and medication incidents; adhering to WHO 5 Moments of Hand Hygiene; practicing statutory Open Disclosure after adverse events. |
| 4. Better Health & Wellbeing | Protecting and promoting the health and wellbeing of the population throughout life transitions. | Supporting smoking cessation, alcohol brief interventions, nutritional screening (MUST tool), and patient discharge education. |
| 5. Leadership, Governance & Management | Clear lines of accountability and responsibility at every level of the organization. | Understanding the ward hierarchy; escalating patient safety concerns to the Clinical Nurse Manager (CNM) and clinical team. |
| 6. Workforce | Ensuring healthcare staff are qualified, competent, supported, and continuously trained. | Maintaining personal professional registration with the NMBI; fulfilling statutory Continuing Professional Development (CPD) requirements. |
| 7. Use of Resources | Transparent, cost-effective, and equitable management of public healthcare funding and resources. | Preventing equipment wastage; managing stock responsibly; avoiding unnecessary single-use consumable disposal. |
| 8. Use of Information | Timely, accurate, secure health information management and digital health records. | Maintaining contemporaneous, objective nursing documentation adhering strictly to GDPR and NMBI recording guidance. |
HIQA Monitoring & Unannounced Inspections
HIQA conducts both announced and unannounced inspections of Irish public acute hospitals. Inspectors examine ward environments, audit infection control standards (monitoring for CPE screening and C. diff protocols), review medication administration storage, interview frontline nursing staff, and inspect patient medical records. HIQA publishes its inspection findings publicly. Where major non-compliance or patient safety hazards are identified, hospital executive leadership must draft and submit a legally binding Compliance Action Plan to rectify the deficiencies within explicit statutory deadlines.
A staff nurse wishes to lead a quality initiative on a surgical ward evaluating whether nursing staff are documenting peripheral intravenous cannula insertion sites and phlebitis scores every 8 hours in accordance with the HSE National Cannula Care Bundle. The nurse is uncertain whether this project constitutes clinical audit or health research. Which of the following statements correctly distinguishes clinical audit from health research?
A multidisciplinary team on an acute stroke unit completes baseline data collection for a clinical audit on dysphagia screening within 4 hours of patient admission. The audit reveals an initial compliance rate of 48% against the national standard of 100%. The team implements a targeted action plan comprising nursing education, bedside screening prompt cards, and revised EHR documentation. According to the 5-stage Clinical Audit Cycle, what is the mandatory next step to successfully close the audit loop?
An acute medical ward experiences repeated delays in administering intravenous antimicrobials within the first hour of recognising sepsis ('Sepsis 6' bundle). The clinical team decides to apply the Model for Improvement and the Plan-Do-Study-Act (PDSA) cycle. Which of the following approaches best exemplifies the principles of a rapid PDSA improvement cycle?