13.2 Analyzing Evaluation Results & Revising Curriculum

Analysis Is a Faculty Judgment Skill

Collecting program data (Section 13.1) is only half of Domain 4 evaluation work. Educators must analyze results and revise curriculum when evidence and context demand change. CNE stems often present noisy or conflicting data and ask which response is educationally responsible: overreact, freeze, or triangulate and act proportionally.

Quick Answer: Interpret multi-source results against program outcomes; weigh learner needs, healthcare trends, and stakeholder feedback; choose the smallest effective curricular revision with a plan to re-evaluate—never anecdote-only overhaul or data-free inertia.

Steps in Analyzing Evaluation Results

1. Organize against the evaluation questions

Return to the plan: For each end-of-program SLO, what do this year’s (and trend) data show? Build a simple findings matrix:

2. Triangulate before concluding

Triangulation means seeking convergence across methods and stakeholders. Examples:

• Exit surveys and employer surveys both flag prioritization → stronger case for curriculum action
• One angry clinical site email alone → investigate, do not redesign the program overnight
• NCLEX dip with stable clinical aggregates and improved employer ratings → explore test policy, cohort composition, or prep supports before gutting clinical courses

3. Check data quality and context

Before blaming curriculum:

• Response rates and representativeness
• Rater drift on clinical tools (need calibration?)
• Cohort size and confidence in percentages
• Concurrent changes (new exam blueprint, pandemic effects, new clinical model, faculty turnover)
• Equity patterns (do gaps concentrate in identifiable groups needing support vs content rewrite?)

4. Distinguish curriculum design problems from other causes

Not every poor outcome is a curriculum map problem:

Domain 4 revision still coordinates with Domain 2 supports and Domain 1 teaching quality—analysis names the right lever.

Decision Inputs for Curriculum Revision

Domain 4 expects revision based on a portfolio of inputs, not a single lobby:

Program outcomes evidence

Primary driver: graduates are not meeting stated SLOs, or assessments show systematic gaps in mapped competencies.

Learner needs

• Progression and remediation patterns
• Student exit themes (e.g., “pharmacology never applied in clinical”)
• Diversity and SDoL-informed barriers that curriculum structure can reduce (scheduling, scaffolding, inclusive cases) without lowering safety standards

Societal and healthcare trends

• Shifts in care settings (ambulatory, telehealth, home-based care)
• Population needs (aging, behavioral health, health equity)
• Informatics and safety science expectations
• Workforce model changes reported by partners

Trends inform priority, not automatic adoption of every fad.

Stakeholder feedback

Faculty retain academic ownership of curriculum while remaining accountable to the public and transparent with partners. Stakeholders inform; they do not replace shared governance.

Types of Curricular Revision (Right-Size the Fix)

Proportionality is a CNE virtue: do not launch a full concept-based conversion because one employer mentioned IV pump skills once.

A Disciplined Revision Process

1. Frame the problem with triangulated findings and outcome language
2. Generate options with faculty (and stakeholders as appropriate)
3. Appraise evidence for proposed pedagogies or structures (literature, peer programs, pilot data)
4. Check constraints: resources, clinical capacity, regulatory/accreditation notification needs, catalog timelines
5. Decide through proper governance (curriculum committee, votes as required)
6. Plan implementation: faculty development, materials, clinical partner orientation
7. Protect students: teach-out, dual pathways, clear communication of catalog rights
8. Define success metrics and a re-evaluation date (close the CQI loop)
9. Document rationale and decisions for continuity and external review

Worked mini-example

Finding: Three-year trend—employer and preceptor feedback cite weak prioritization; senior clinical tool items on priority setting below benchmark; NCLEX stable.
Interpretation: Curriculum likely under-practices clinical judgment integration despite licensure success.
Revision: Increase unfolding cases and simulation hours mapped to judgment outcomes in Levels 2–3; calibrate clinical tool; faculty development on coaching thinking aloud; re-measure clinical items and employer survey in 18 months.
Not chosen: Immediate cut of all specialty content or blaming one clinical instructor without patterns.

Communicating and Negotiating Change

Analysis that never leaves a subcommittee fails. Effective educators:

• Present findings in plain language with visuals (trends, not only raw dumps)
• Separate “what we know,” “what we infer,” and “what we propose”
• Invite alternative explanations
• Avoid shaming cohorts or individual faculty in public forums
• Connect proposals to mission and public safety

Conflict is normal when content is cut or ownership shifts; managing it overlaps Domain 5 leadership but begins with fair use of evidence here.

Common CNE Traps

Bottom Line for Domain 4 Tasks H–I

Analyze evaluation results with triangulation, data-quality checks, and outcome language. Revise curriculum when evidence, learner needs, trends, and stakeholder input justify change—proportionally, through governance, with student transition fairness and a plan to re-evaluate. On CNE items, reject pure anecdote, pure inertia, single-metric panic, and stakeholder-blind redesign.