16.3 Evidence-Based Practice, Clinical Inquiry & Quality Improvement
Key Takeaways
Evidence-Based Practice (EBP) integrates the best available research evidence with advanced clinical expertise and patient values across a 5-step cycle: Ask, Acquire, Appraise, Apply, and Assess.
The PICO/PICOT framework organizes clinical inquiry questions into Population, Intervention, Comparison, Outcome, and Timeframe to optimize biomedical search strategies and practice change design.
The Hierarchy of Evidence pyramid ranks systematic reviews and meta-analyses of randomized controlled trials (RCTs) at Level I, descending to individual RCTs (Level II), quasi-experimental trials (Level III), observational cohort studies (Level IV), and expert consensus (Level VII).
Critical appraisal requires evaluating internal and external validity, interpreting 95% confidence intervals, and calculating effect metrics including Relative Risk (RR), Odds Ratio (OR), Absolute Risk Reduction (ARR), and Number Needed to Treat (NNT).
QI improves local care through iterative testing and measurement. Run charts track data around a median; control charts add statistically calculated limits. Nonrandom patterns prompt investigation and assessment of sustained improvement.
16.3 Evidence-Based Practice, Clinical Inquiry & Quality Improvement
Clinical Scenario: In an 18-bed trauma-surgical intensive care unit (TSICU), the quarterly dashboard reveals that the central line-associated bloodstream infection (CLABSI) rate has risen to 3.6 per 1,000 line-days (local improvement target < 0.8). The lead AGACNP spearheads a clinical inquiry initiative evaluating whether transitioning from standard dressings to a bundle combining 2% chlorhexidine gluconate-impregnated gel dressings with alcohol disinfection caps reduces CLABSI rates. Navigating this initiative requires formulating an answerable clinical question, appraising literature, distinguishing quality improvement from research, executing rapid-cycle Plan-Do-Study-Act (PDSA) tests, and analyzing run charts to distinguish common cause from special cause variation.
Evidence-Based Practice (EBP) & The 5-Step Process
Defined by David Sackett and colleagues, Evidence-Based Practice (EBP) is the conscientious integration of the best external research evidence with clinical expertise and patient values and preferences within a specific clinical context.
The clinical inquiry workflow follows the 5-Step EBP Process:
- Ask: Formulate an answerable, structured clinical practice question.
- Acquire: Systematically search biomedical databases (PubMed, CINAHL, Cochrane Library) for top-tier evidence.
- Appraise: Critically evaluate evidence for internal validity (methodological rigor), external validity (generalizability), and clinical significance (magnitude of effect).
- Apply: Integrate evidence with clinical judgment, institutional resources, and patient values to implement practice changes.
- Assess: Evaluate post-implementation outcomes, monitoring for clinical efficacy, balancing measures, and sustainability.
Formulating Clinical Questions: The PICO / PICOT Framework
Clinicians utilize the PICOT framework to structure searchable inquiry questions:
- P (Population/Problem): Adult ICU patients with central venous catheters.
- I (Intervention): 2% chlorhexidine gel dressings combined with alcohol disinfection caps.
- C (Comparison): Standard transparent semipermeable polyurethane dressings without chlorhexidine.
- O (Outcome): Incidence of laboratory-confirmed CLABSI per 1,000 line-days.
- T (Timeframe): Duration of central catheterization in the ICU.
The Hierarchy of Evidence Pyramid
The strength of clinical evidence is ranked using the established Hierarchy of Evidence (Melnyk & Fineout-Overholt framework):
| Evidence Level | Study Design & Methodological Description |
|---|---|
| Level I | Systematic reviews and meta-analyses of randomized controlled trials (RCTs); clinical practice guidelines based on systematic reviews of RCTs. Appraise review quality and the included trials. |
| Level II | Well-designed individual randomized controlled trials (RCTs). |
| Level III | Controlled trials without randomization (quasi-experimental, non-randomized prospective intervention studies). |
| Level IV | Well-designed observational studies: prospective cohort, retrospective cohort, and case-control studies. |
| Level V | Systematic reviews of descriptive and qualitative studies. |
| Level VI | Single descriptive, cross-sectional, or qualitative studies; case series. |
| Level VII | Opinions of authorities and expert consensus committee reports. Lowest design level in this clinical hierarchy. |
Critical Appraisal: Statistical vs. Clinical Significance & Effect Metrics
Appraising clinical literature requires evaluating validity and quantitative effect metrics:
- Internal Validity: Degree to which study findings are free from methodological bias, confounding, and measurement error.
- External Validity: Generalizability of study findings to outside patient populations.
- Statistical vs. Clinical Significance: A p-value measures how incompatible the data are with a specified null model; p < 0.05 is a conventional significance threshold. Clinical significance asks whether the effect is large enough to matter to patients.
- 95% Confidence Intervals (CI): Reflects effect precision. For ratio metrics (Relative Risk [RR], Odds Ratio [OR], Hazard Ratio [HR]), if the 95% CI encompasses 1.0, the result is not statistically significant (p ≥ 0.05). For difference metrics (Absolute Risk Reduction, mean difference), if the 95% CI encompasses 0, the result is not statistically significant.
Clinical Effect Calculations
- Relative Risk (RR): Ratio of event risk in the experimental group to the control group: RR = EER / CER.
- Odds Ratio (OR): Ratio of odds of an event in the exposed group to the unexposed group.
- Absolute Risk Reduction (ARR): Absolute difference in event rates: ARR = CER - EER.
- Number Needed to Treat (NNT): Number of patients needed to receive experimental therapy to prevent one adverse outcome: NNT = 1 / ARR. Always rounded UP to the nearest whole integer. Lower NNT indicates greater clinical potency.
- Number Needed to Harm (NNH): Number of patients exposed resulting in one adverse event: NNH = 1 / ARI (where ARI = EER - CER). Always rounded DOWN to the nearest whole integer. Higher NNH indicates safer therapy.
Quality Improvement (QI) vs. Clinical Research
Distinguishing QI from human subjects research is an essential professional responsibility:
- Research: A systematic investigation designed to develop or contribute to generalizable knowledge. Methods may be quantitative or qualitative and need not involve blinding or control groups. Applicable human-subjects rules determine IRB review, exemptions and consent; an IRB may approve consent or documentation waivers when regulatory criteria are met.
- Quality Improvement: Work directed at improving local care, processes and outcomes, often using iterative tests. Activities limited to local improvement may be nonresearch rather than exempt research. A project can have both QI and research purposes; obtain the institution’s determination and required oversight before proceeding. Intent to publish alone does not make QI research.
The Model for Improvement & PDSA Rapid Cycles
The IHI Model for Improvement addresses three core questions followed by testing cycles:
- What are we trying to accomplish? Establish a SMART Aim (e.g., 'Reduce TSICU CLABSI from 3.6 to < 1.0 per 1,000 line-days in 6 months').
- How will we know that a change is an improvement? Measure Outcome Measures (CLABSI rate), Process Measures (dressing bundle compliance rate), and Balancing Measures (contact dermatitis incidence).
- What changes can we make that will result in improvement? Select evidence-based interventions.
The Plan-Do-Study-Act (PDSA) Cycle
- Plan: Formulate the change test, establish predictions, and plan data collection.
- Do: Carry out the test on a small scale (e.g., pilot bundle on Beds 1–4 for one week); document barriers.
- Study: Analyze post-implementation data, compare to predictions, and summarize lessons.
- Act: Decide to Adopt hospital-wide, Adapt based on feedback, or Abandon and test an alternative.
Lean Six Sigma & Statistical Process Control (SPC)
Lean Six Sigma eliminates waste and reduces clinical process variation:
- Process Mapping: Visualizing workflow steps to eliminate delays and handoff waste.
- Ishikawa (Fishbone) Diagram: Categorizes root causes of quality defects across People, Methods, Machines/Equipment, Materials, Measurement, and Environment.
- Pareto Chart: Bar chart and cumulative percentage line based on the Pareto 80/20 Principle: ~80% of errors stem from ~20% of root causes.
- Run Charts: Plot results over time against a baseline median, without control limits. Apply a specified rule set consistently: commonly six consecutive points on one side of the median indicate a shift, and five increasing or decreasing points indicate a trend. Some conventions use longer sequences.
- Control Charts: Add a process-specific centerline and statistically calculated control limits, commonly 3-sigma limits. Use rules appropriate to the chart and data; a point beyond a control limit can signal special cause.
- Interpretation: Common-cause variation belongs to the system and generally requires system redesign. A nonrandom signal warrants investigation of possible changes. Review data quality, exposure denominators, concurrent changes and balancing measures before attributing clinical improvement to an intervention.
Nurse-Sensitive Quality Indicators & Benchmarking
The National Database of Nursing Quality Indicators (NDNQI) benchmarks nursing-sensitive outcomes such as CAUTI, CLABSI, ventilator-associated events, hospital-acquired pressure injuries, and patient falls, alongside workforce measures. Compare similar units using the same indicator definition, reporting period, and denominator; a local improvement target is not automatically a national benchmark.
An AGACNP is reviewing a prospective multicenter randomized controlled trial evaluating a novel intravenous vasopressor versus norepinephrine in septic shock. The primary endpoint of 28-day all-cause mortality was 22% in the experimental vasopressor group and 30% in the control norepinephrine group (Relative Risk 0.73, 95% Confidence Interval 0.60 to 0.89, p = 0.002). What is the calculated Absolute Risk Reduction (ARR) and the Number Needed to Treat (NNT) to prevent one death at 28 days?
ARR is 12%; NNT is 9 patients.
ARR is 27%; NNT is 4 patients.
ARR is 4%; NNT is 25 patients.
ARR is 8%; NNT is 13 patients.
An acute care nurse practitioner is analyzing a monthly median-based run chart tracking catheter-associated urinary tract infections (CAUTIs) in the neuro-ICU following implementation of an automatic electronic catheter removal prompt. The historical baseline median is 5 infections per month. For the last 9 consecutive months following protocol launch, the infection counts have been 2, 1, 0, 2, 1, 1, 0, 2, and 1—all falling strictly below the historical centerline. How should this run chart pattern be interpreted under SPC quality improvement rules?
The data pattern reflects common cause variation inherent to random statistical noise, requiring no modification to unit workflows.
The nine consecutive points below the baseline median signal a nonrandom downward shift, warranting review of catheter-days and process changes before attributing improvement
The data indicates an out-of-control system characterized by measurement error, requiring the catheter removal prompt to be disabled immediately.
The chart indicates an unstable process because no single data point has breached the upper control limit.
An AGACNP is developing a clinical inquiry question to determine whether subglottic secretion drainage endotracheal tubes reduce the incidence of ventilator-associated pneumonia (VAP) compared to conventional endotracheal tubes in mechanically ventilated trauma patients. According to the established hierarchy of evidence, which publication design provides the highest design level (Level I) to guide clinical practice change?
A prospective multicenter observational cohort study evaluating 2,500 trauma patients over a 3-year period.
A well-designed single randomized controlled trial conducted across two academic level 1 trauma centers.
A systematic review and meta-analysis of multiple randomized controlled trials comparing subglottic drainage to standard endotracheal tubes.
An expert consensus guideline published by the Eastern Association for the Surgery of Trauma (EAST).
Sections you finish are checked off in the contents.
You've completed this section
Continue exploring other exams