5.1 Evaluation Purpose and Types

Why Area IV Matters on the CHES Exam

Area IV, Evaluation and Research, is one of the eight Areas of Responsibility defined by the National Commission for Health Education Credentialing (NCHEC) in the 2020 Health Education Specialist Practice Analysis (HESPA II). The Certified Health Education Specialist (CHES) exam is computer-based, delivered at PSI test centers or via PSI Bridge live remote proctoring, and contains 165 multiple-choice items of which 150 are scored and 15 are unscored pilot items. Candidates have 3 hours; passing requires a scaled score of 600 on an 800-point scale.

Area IV carries 12% of the current eight-Area HESPA II 2020 blueprint — the weight tested through the October 14-24, 2026 exam, the last exam built on this outline. Starting with the April 22-May 1, 2027 exam, NCHEC's new Nine-Area HESPA III 2025 outline splits this content into a standalone Evaluation area (15%) and a separate Research area (3%). Whichever exam you are sitting, know this area cold, because evaluation logic also appears inside Planning (Area II) and Implementation (Area III) items.

The exam does not ask whether evaluation is "good." It asks what a specialist should measure, when, and how to use findings responsibly. That makes Area IV an applied decision process, not a vocabulary quiz.

The Four Evaluation Types

• Formative evaluation improves a program before or during development (pretesting materials, pilot testing a curriculum, reviewing reading level).
• Process evaluation checks whether implementation happened as planned: fidelity, dose delivered, dose received, reach, and recruitment.
• Impact evaluation looks for shorter-term change in knowledge, attitudes, skills, self-efficacy, intentions, behaviors, or environmental supports.
• Outcome evaluation examines longer-term, broader change such as morbidity, mortality, quality of life, policy adoption, or community conditions.

A note on terminology: this guide follows the health-education-planning convention used by CHES prep sources (McKenzie, Neiger & Thackeray; the Rural Health Information Hub) — impact evaluation for short-term participant change, outcome evaluation for long-term health status change. Some CDC logic-model materials use "impact" and "outcome" in the opposite sense; always check which convention a given source is using.

A Common Exam Trap

A frequent distractor is choosing an impact measure when the scenario describes a delivery problem. If attendance was low, facilitators skipped activities, or flyers never reached the priority population, the next step is process oriented, not impact oriented. If the program ran as intended and the question is whether participants changed, impact evaluation fits.

Writing the Evaluation Question

A weak question asks, "Did the program work?" A strong one names the population, expected change, topic, and measurement points: "Did participating ninth-grade students increase correct condom-use knowledge from baseline to immediate posttest?" That is impact focused. "Were at least four of six planned parent sessions delivered with the approved curriculum and trained facilitators?" is process focused.

Anchor to the Logic Model

Use the program logic model to stay anchored. Inputs and activities generate process indicators. Outputs (number reached, sessions completed, materials distributed, referrals made) show dose and reach. Short-term outcomes include awareness, self-efficacy, and skills; intermediate outcomes involve behavior or policy adoption; long-term outcomes usually require more time, larger samples, or surveillance data.

Evaluation is also an ethical responsibility. Programs consume public trust, participant time, staff labor, and grant funding. Collecting data that will never be used burdens communities; reporting only favorable findings misleads partners. A CHES-level answer balances feasibility with transparency, cultural humility, confidentiality, and usefulness.

Process vs Impact vs Outcome in Numbers

A worked example clarifies the boundaries. A diabetes self-management program plans six weekly classes for 60 enrolled adults. Process measures ask whether the program was delivered: 5 of 6 classes were held, each covered the planned topics, and the average participant attended 4.2 of 6 sessions (dose received about 70%). Impact measures ask whether participants changed: mean correct carbohydrate-counting knowledge rose from 58% to 81%, and the share reporting daily glucose checks rose from 40% to 68% at three months.

Outcome measures ask whether health or systems shifted: the clinic's proportion of enrolled patients with controlled HbA1c rose over the following year. Notice that without the process data, a flat result could mean either an ineffective curriculum or one that was barely delivered, which is why process evidence is needed to interpret impact and outcome measures.

Formative Evaluation Tools

Formative work is not vague brainstorming; it uses concrete techniques. Pretesting shows draft messages to members of the priority population to check comprehension, recall, and acceptability. Readability checks apply formulas such as Flesch-Kincaid or SMOG to confirm materials sit near a sixth- to eighth-grade reading level for general audiences. Pilot testing runs the full procedure with a small group to surface logistical problems before full rollout. Expert and stakeholder review confirms cultural fit and content accuracy.

On the exam, any item set before launch that asks "how do we make this better" points to formative evaluation, while "did it reach people as planned" points to process.

Scenario Sorting Step

First locate the program stage. Materials being drafted means formative. Staff delivering sessions means process. Participants expected to change knowledge, skill, or behavior means impact. Population health, policy effects, or long-term conditions means outcome. Then identify the decision maker and the decision: a funder needs accountability, a manager needs fidelity data, a coalition needs priority-setting evidence, and participants deserve accessible results. The best choice fits the decision, not the most rigorous-sounding design.

Quick Reference: Matching Type to Trigger Words

• "Before launch," "pretest the brochure," "is it understandable" -> formative
• "Were sessions delivered," "fidelity," "reach," "dose," "attendance" -> process
• "Did knowledge/behavior/self-efficacy change," "pre to post" -> impact
• "Disease rates," "policy adopted," "quality of life," "long term" -> outcome