17.2 Quality Improvement, Program Evaluation & Population Health
Key Takeaways
- Domain 4 Task 1 requires methods for applying continuous quality improvement processes to service delivery, naming program evaluation and outcome measures, and separately requires evidence-based programming for advancing population health outcomes.
- Quality assurance is retrospective and inspects for individual error; continuous quality improvement is prospective, ongoing, and redesigns the system that allowed the error.
- The Plan-Do-Study-Act cycle tests a change on a small scale before spreading it, and root cause analysis asks why a failure happened at the system level rather than who caused it.
- A logic model links inputs to activities, outputs, outcomes, and long-term impact, and distinguishes formative evaluation during a program from summative evaluation of its results.
- The blueprint's population health examples are aging in place, fall prevention, health and wellness, and community support groups — all areas with established occupational therapy evidence.
Quality Improvement, Program Evaluation & Population Health
Domain 4 asks the OTR to employ evidence-based strategies and approaches to provide safe, effective, and efficient services relevant to individuals, groups, and populations. Two of its three knowledge statements move beyond the individual client: continuous quality improvement processes and evidence-based programming for advancing population health outcomes.
1. Quality Assurance versus Continuous Quality Improvement
| Quality Assurance (QA) | Continuous Quality Improvement (CQI) | |
|---|---|---|
| Orientation | Retrospective — inspects after the fact | Prospective and ongoing |
| Focus | Finding outliers and deficiencies | Improving the whole process |
| Standard | A minimum threshold | Continuous raising of performance |
| Response to error | Identify and correct the individual | Redesign the system that allowed the error |
| Culture | Compliance and blame | Learning and participation |
The cultural distinction drives exam items. When a client falls, a quality assurance response asks who was assigned; a continuous quality improvement response asks why the system permitted it — was the bed alarm functional, was the call bell in reach, was the toileting schedule followed, was the staffing ratio adequate at that hour?
Just culture sits underneath this: distinguish honest human error (console and fix the system) from at-risk behavior (coach) from reckless behavior (discipline). Punishing honest error simply drives reporting underground and removes the data you need.
2. Quality Improvement Methods
The Plan-Do-Study-Act Cycle
| Phase | Action |
|---|---|
| Plan | Define the problem, gather baseline data, and state a specific, measurable aim and a change hypothesis |
| Do | Implement the change on a small scale — one unit, one shift, five clients |
| Study | Compare results against the baseline; ask what was learned, including what went wrong |
| Act | Adopt, adapt, or abandon — then spread the change or run another cycle |
The point of a small-scale test is to learn cheaply. Rolling a change out to an entire department before testing it is the most common quality improvement failure.
Other Tools to Recognize
- Root cause analysis: a structured retrospective investigation after a serious adverse event, asking "why" repeatedly until system-level causes surface. Focused on process, not blame.
- Failure mode and effects analysis: prospective — identifies how a process could fail before it does.
- Fishbone (Ishikawa) diagram: organizes possible causes by category (people, process, equipment, environment, materials, management).
- Run charts and control charts: plot a measure over time to distinguish real change from ordinary variation.
- Lean: eliminates waste — waiting, unnecessary motion, rework, overproduction.
- Six Sigma (DMAIC): Define, Measure, Analyze, Improve, Control — reduces variation.
- Benchmarking: comparing performance against peer organizations or published standards.
Reporting Infrastructure
- Incident reports for adverse events and, importantly, near misses — near misses are free lessons.
- Sentinel events: unexpected occurrences involving death or serious physical or psychological injury, triggering mandatory review.
- Accreditation bodies — the Joint Commission and CARF among them — audit these processes; occupational therapy managers routinely contribute chart audits, competency records, and outcome data.
3. Program Evaluation
Program evaluation asks whether a program, not a client, is working.
The Logic Model
| Component | Question | Occupational Therapy Example (Falls Program) |
|---|---|---|
| Inputs | What resources go in? | Two OTRs, screening tools, grab bar stock, community space |
| Activities | What is done? | Home evaluations, group education, equipment installation |
| Outputs | What is produced? | 120 home evaluations completed; 85 clients trained |
| Outcomes | What changes for participants? | Reduced fall rate, improved Berg scores, improved confidence |
| Impact | What changes long term? | Reduced hip fractures and delayed nursing home placement |
Formative versus Summative
- Formative evaluation occurs during the program and improves it while it runs — attendance patterns, participant feedback, fidelity checks.
- Summative evaluation occurs after and judges results — did the program achieve its outcomes, and should it continue?
Process versus Outcome Measures
- Process measures capture whether the work was done as intended: percentage of eligible clients screened, evaluations completed within 24 hours, documentation compliance.
- Outcome measures capture whether it made a difference: functional change scores, falls per 1,000 patient days, readmission rate, length of stay, satisfaction, return-to-work rate.
- Balancing measures catch unintended consequences: did shortening length of stay raise readmissions?
Commonly used outcome instruments at the program level include Section GG functional abilities data in post-acute care, the Canadian Occupational Performance Measure, condition-specific measures such as the DASH, and patient-reported experience surveys.
4. Population Health
Population health shifts the unit of intervention from the person to the group or community.
| Prevention Level | Target | Occupational Therapy Example |
|---|---|---|
| Primary | Prevent the condition from occurring | Workplace ergonomics program; school-wide handwriting and sensory-friendly classroom design; community fall prevention |
| Secondary | Detect early and intervene | Fall risk screening at a senior center; developmental screening in preschool; depression screening in primary care |
| Tertiary | Limit disability and prevent complications | Chronic disease self-management programs; skilled maintenance therapy; caregiver training to prevent readmission |
Evidence-Based Programs the Blueprint Points To
Aging in place. The CAPABLE model — Community Aging in Place, Advancing Better Living for Elders — pairs an occupational therapist, a registered nurse, and a handyworker across a short series of home visits, working from client-identified goals with a modest repair budget. It has demonstrated reduced disability and cost savings, and it is the flagship example of occupational therapy in population health.
Fall prevention. Falls are the leading cause of injury-related death among adults aged 65 and older, and roughly one in four older adults falls each year. Evidence-supported programs include the Otago Exercise Programme (individually prescribed strength and balance exercise with a walking plan), Tai Chi, A Matter of Balance (which targets fear of falling and activity restriction), and Stepping On. The CDC's STEADI initiative structures screening, assessment, and intervention in primary care, and occupational therapy contributes the home hazard evaluation, medication-effect screening, vision and footwear review, and activity-specific training.
Health and wellness. Lifestyle Redesign, derived from the Well Elderly Study, delivers preventive occupational therapy as a structured group program supporting healthy routine building. It demonstrated meaningful health and quality-of-life benefits and is one of the profession's strongest population-level evidence bases.
Community support groups. Facilitated peer groups for stroke survivors, caregivers, people with low vision, or people in recovery combine social participation, education, and problem solving — and the occupational therapist's contribution is the occupational focus, not simply the facilitation.
Designing a Population Health Program
- Community needs assessment — data on prevalence, disparities, and existing services, plus input from the community itself.
- Identify the population and the occupational problem in occupational terms, not diagnostic ones.
- Select an evidence-based program or adapt one, documenting the adaptation.
- Build a logic model with measurable outcomes before you start.
- Attend to fidelity — an adapted program still needs its active ingredients intact.
- Address access barriers — transportation, cost, language, literacy, scheduling, childcare — because a program the target population cannot reach has no effect.
- Evaluate and report. Data is what sustains funding, and dissemination is what lets other communities use what you learned.
5. The Occupational Therapy Manager's Contribution
Quality and population health are where occupational therapists move from delivering care to shaping systems:
- Tracking outcome data by diagnosis and setting to demonstrate value to payers and administrators.
- Auditing documentation and competency records for regulatory readiness.
- Running productivity and staffing analyses that protect both quality and clinician sustainability.
- Building and maintaining standard operating procedures and equipment maintenance schedules.
- Serving on ethics, falls, safety, and readmission committees.
- Advocating — an OTPF-4 intervention — for policy, funding, and access at the organizational and community level.
An occupational therapy department discovers that three clients have fallen during toileting transfers in the past month, each with a different therapist. Which response BEST reflects continuous quality improvement rather than quality assurance?
An occupational therapist is designing a community program to help older adults remain safely in their own homes and wants to select an approach with established evidence. Which model is MOST directly aligned with this goal?
An occupational therapy manager is evaluating a new falls prevention program and reports that 120 home evaluations were completed and 85 clients received equipment training. A director asks whether the program is working. What type of data is still missing?