8.2 Kirkpatrick's Four-Level Evaluation Model in Recreation

Kirkpatrick's Four-Level Evaluation Model in Recreation

To build a comprehensive, defensible evaluation system, park and recreation agencies must look beyond simple customer satisfaction smile sheets. While knowing whether participants enjoyed an activity is useful, it does not demonstrate whether participants learned new competencies, altered their daily health behaviors, or generated a positive return on investment for the community. The Kirkpatrick Four-Level Evaluation Model, originally developed by Dr. Donald Kirkpatrick for training evaluation and widely adapted across public recreation and human services, provides the standard hierarchical framework for measuring multi-dimensional program impact. On the CPRP exam, candidates must be prepared to identify, design, and analyze evaluation strategies across all four Kirkpatrick levels.

---

1. Overview of the Kirkpatrick Evaluation Hierarchy

The Kirkpatrick model is structured as an ascending pyramid. As an agency moves from Level 1 to Level 4, the evaluation requires greater financial investment, longer time horizons, and more rigorous methodology, but delivers substantially greater strategic value to civic leaders, grantors, and policymakers.

+-----------------------------------------------------------------------------------+
|                    KIRKPATRICK'S FOUR LEVELS IN RECREATION                        |
+-----------------------------------------------------------------------------------+
| LEVEL 4: RESULTS   | Macro-community impacts (crime reduction, chronic disease    |
| (Societal Impact)  | management, economic return on investment, social capital).  |
|--------------------|--------------------------------------------------------------|
| LEVEL 3: BEHAVIOR  | Behavioral transfer and sustained habits outside of class    |
| (Application)      | (home physical activity, independent outdoor recreation).    |
|--------------------|--------------------------------------------------------------|
| LEVEL 2: LEARNING  | Competencies acquired during the program (knowledge gained,  |
| (Skill Mastery)    | physical stroke mechanics, CPR certification pass rates).    |
|--------------------|--------------------------------------------------------------|
| LEVEL 1: REACTION  | Immediate customer satisfaction (instructor enthusiasm, room |
| (Satisfaction)     | temperature, registration ease, Net Promoter Score NPS).     |
+-----------------------------------------------------------------------------------+

---

2. Deep-Dive into the Four Kirkpatrick Levels

Level 1: Reaction (Customer Experience & Perceived Quality)

• Core Question: How did participants react to the program, instructor, facility, and customer service?
• Scope: Measures customer satisfaction, perceived instructor competence, comfort of physical surroundings, equipment adequacy, and likelihood of recommending the service.
• Relevance in Parks & Recreation: While Level 1 is the most commonly measured tier due to its ease of administration, high satisfaction alone does not prove learning or community impact.
• Key Metrics & Tools:
  • Post-Session Likert Questionnaires: Short digital surveys sent via email/SMS immediately after the final class.
  • Net Promoter Score (NPS): Calculated from a single gold-standard question: "On a scale from 0 to 10, how likely are you to recommend this program to a friend or neighbor?" $\text{NPS} = \%\text{ Promoters (Scores 9–10)} - \%\text{ Detractors (Scores 0–6)}$ (Respondents scoring 7–8 are classified as "Passives" and excluded from the net percentage calculation).
  • Youth Smiley-Face Scales: Non-verbal pictorial rating scales (grinning face, neutral face, frowning face) used for early childhood camps and adaptive recreation programs.

Level 2: Learning (Knowledge, Skills & Attitudes)

• Core Question: What specific competencies, knowledge, or physical skills did participants acquire during the program?
• Scope: Measures the direct cognitive, psychomotor, or affective learning that occurred as a result of the structured curriculum.
• Key Metrics & Tools:
  • Pre-Test / Post-Test Skill Demonstrations: Administering identical performance rubrics during Session 1 and the final session (e.g., measuring youth swim stroke mechanics, basketball free-throw accuracy, or archery grouping).
  • Written & Digital Knowledge Quizzes: Testing cognitive retention in hunter safety, boater certification, Master Gardener workshops, or babysitter training courses.
  • Certification Pass Rates: Tracking the percentage of participants achieving formal credentialing (e.g., American Red Cross Lifeguard, CPR/AED, Wilderness First Aid).
  • Attitudinal Rubrics: Measuring changes in environmental conservation attitudes following a 4-week nature camp.

Level 3: Behavior (Application & Behavioral Transfer)

• Core Question: Did participants apply their newly acquired skills and adopt sustained lifestyle changes in their daily lives outside the classroom?
• Scope: Evaluates behavioral transfer—whether the knowledge or habits formed in the program translate into regular, unprompted practice in home, school, workplace, or community settings over time.
• Relevance in Parks & Recreation: Level 3 is the bridge between educational programming and genuine public health enhancement. For example, learning to swim (Level 2) is valuable, but swimming laps three times a week at the community pool six months later (Level 3) represents true behavioral change.
• Key Metrics & Tools:
  • Longitudinal Follow-Up Surveys (30, 60, 90, or 180 Days Post-Program): Contacting participants months after course completion to survey physical activity frequency, healthy dietary habits, or ongoing hobby engagement.
  • Self-Reported Activity Logs & Wearables: Tracking daily step counts, fitness app logs, or active park visits.
  • Parent / Caregiver Observational Reports: Surveying parents three months after a youth social-skills camp to assess whether children demonstrate improved conflict resolution at home and school.

Level 4: Results (Societal, Community & Organizational Impact)

• Core Question: What macro-level community, economic, or public health benefits occurred as a result of the program?
• Scope: Measures broad societal outcomes, community-wide return on investment (ROI), and the tangible realization of municipal master plan goals.
• Relevance in Parks & Recreation: Level 4 provides the definitive data required to defend public tax subsidies, secure multi-million-dollar federal grants (e.g., Land and Water Conservation Fund, CDC Healthy Communities), and achieve municipal legislative buy-in.
• Key Metrics & Tools:
  • Epidemiological & Public Health Indicators: Collaborating with county health departments to track reductions in childhood obesity, Type 2 diabetes prevalence, or senior fall-related emergency room admissions in zip codes served by intensive wellness initiatives.
  • Public Safety & Crime Statistics: Analyzing municipal police call logs to verify reductions in juvenile delinquency, vandalism, or anti-social incidents between 3:00 PM and 7:00 PM in neighborhoods hosting active teen drop-in centers.
  • Economic Impact Analysis: Calculating direct municipal tax revenue, hotel room nights, and local business expenditures generated by hosting regional sports tournaments.
  • Social Return on Investment (SROI): Quantifying monetized social value generated per dollar of municipal investment (e.g., every $1.00 invested in youth mentoring saves $3.50 in juvenile justice and remedial education costs).

---

3. Data Collection Strategies Across Kirkpatrick Levels

+-----------------------------------------------------------------------------------+
|                 DATA COLLECTION STRATEGY MATRIX BY KIRKPATRICK LEVEL              |
+-----------------------------------------------------------------------------------+
| LEVEL     | FOCUS VARIABLE        | DATA COLLECTION TIMING | INSTRUMENTATION      |
|-----------|-----------------------|------------------------|----------------------|
| Level 1   | Satisfaction / NPS    | At / immediately after | Digital exit survey, |
| Reaction  | Perceived quality     | final class session    | kiosk touchscreen    |
|-----------|-----------------------|------------------------|----------------------|
| Level 2   | Skill mastery         | Session 1 (Pre-test)   | Rubrics, practical   |
| Learning  | Knowledge gained      | & Final Session (Post) | skills test, quizzes |
|-----------|-----------------------|------------------------|----------------------|
| Level 3   | Behavioral transfer   | 3 to 6 months post-    | Longitudinal survey, |
| Behavior  | Lifestyle application | program completion     | fitness logs, parent |
|-----------|-----------------------|------------------------|----------------------|
| Level 4   | Community ROI, health | 1 to 3+ years          | Health data matching,|
| Results   | Crime reduction       | longitudinal tracking  | police data, SROI    |
+-----------------------------------------------------------------------------------+

---

4. Kirkpatrick 4-Level Evaluation Framework in Recreation Table