11.1 Formative and Summative Client Evaluation

Formative and Summative Client Evaluation

Core Clinical Mandate: In therapeutic recreation, evaluation is not merely an administrative conclusion to service delivery; it is the vital feedback mechanism that drives evidence-based practice. Within the APIED process (Assessment, Planning, Implementation, Evaluation, Documentation), evaluation provides the objective empirical data required to validate intervention efficacy, protect client safety, justify third-party reimbursement, and uphold professional accountability. A Certified Therapeutic Recreation Specialist (CTRS) must master both formative (in-process) and summative (outcome-focused) evaluation methodologies to make sound clinical decisions regarding treatment continuation, modification, progression, and discharge.

---

Foundational Principles of Client-Level Evaluation

Client-level evaluation is the systematic, continuous collection and analysis of functional and behavioral data to determine the extent to which an individual client has achieved their individualized treatment goals and objectives. While assessment establishes the initial functional baseline and treatment planning defines measurable goals, evaluation measures the trajectory of change resulting from recreational therapy interventions.

+-------------------------------------------------------------------------------------------------+
|                      THE APIED CLINICAL EVALUATION CONTINUUM IN RT                              |
|                                                                                                 |
|   +-------------------+      +-------------------+      +-----------------------------------+   |
|   |    ASSESSMENT     | ---> |     PLANNING      | ---> |          IMPLEMENTATION           |   |
|   | Baseline Function |      | Measurable Goals  |      |   Targeted Modalities & Protocols |   |
|   +-------------------+      +-------------------+      +-----------------------------------+   |
|                                                                           |                     |
|                                                                           v                     |
|   +-----------------------------------------------------------------------------------------+   |
|   |                           FORMATIVE EVALUATION (Concurrent)                             |   |
|   |   - Real-time behavioral observation & prompt adjustment                                |   |
|   |   - Scaffolding / Grading activity challenge up or down                                 |   |
|   |   - Immediate clinical adaptation of adaptive equipment or environment                  |   |
|   +-----------------------------------------------------------------------------------------+   |
|                                                                           |                     |
|                                                                           v                     |
|   +-----------------------------------------------------------------------------------------+   |
|   |                           SUMMATIVE EVALUATION (Terminal)                               |   |
|   |   - Post-intervention standardized re-testing (Delta = Post - Pre)                      |   |
|   |   - Goal Attainment Scaling (GAS) composite scoring (-2 to +2)                          |   |
|   |   - Discharge readiness, functional plateau determination, community transition planning|   |
|   +-----------------------------------------------------------------------------------------+   |
+-------------------------------------------------------------------------------------------------+

Evaluation is governed by two complementary operational frameworks: Formative Evaluation and Summative Evaluation.

---

Formative Client Evaluation: Ongoing Process Optimization

Formative client evaluation is an ongoing, dynamic, process-oriented assessment executed concurrently throughout the implementation of therapeutic recreation interventions. Rather than waiting for the conclusion of a multi-week program, the CTRS continuously monitors client responses, physiological tolerances, emotional states, and behavioral outputs during session delivery.

Clinical Purposes of Formative Evaluation

1. Real-Time Intervention Adaptation: Immediate micro-adjustments to task demands, physical pacing, or cognitive complexity in response to client fatigue, frustration, or rapid mastery.
2. Prompt Hierarchy Management: Systematically titrating physical, verbal, or gestural prompts along the least-to-most intrusive prompting continuum to promote independence.
3. Safety and Physiological Monitoring: Tracking vital signs, pain ratings, range-of-motion limits, spasticity, behavioral escalation cues, or autonomic dysreflexia symptoms during physical and experiential modalities.
4. Environmental and Equipment Optimization: Modifying lighting, acoustic levels, seating ergonomics, or adaptive equipment attachments (e.g., switching from a universal cuff to a built-up grip handle) to optimize participation.
5. Client Engagement and Rapport Building: Assessing affective responses and intrinsic motivation to pivot between activity modalities while maintaining alignment with target clinical objectives.

In-Session Formative Decision Points

• Prompt Adjustment (Grading Assistance): When a client with a traumatic brain injury (TBI) struggles to sequence steps in an adaptive cooking intervention, the CTRS shifts from a general verbal prompt ("What is your next step?") to a direct verbal prompt ("Pick up the measuring cup") or modeling. Conversely, when the client demonstrates success, the therapist fades assistance to indirect gestural cues.
• Activity Challenge Grading (Scaffolding): In an adaptive rock climbing session for an adolescent with cerebral palsy, the CTRS grades the activity downward by introducing a top-rope pulley assist when muscle fatigue impairs ascent, or grades it upward by eliminating specific hold colors to challenge motor planning and balance.
• Behavioral De-escalation: In an inpatient adolescent psychiatric stress-management group, noticing signs of agitation (clenched fists, rapid pacing), the CTRS formatively alters the session plan, transitioning from an interactive group discussion to an individual progressive muscle relaxation or sensory grounding exercise.

---

Summative Client Evaluation: Outcome Measurement & Efficacy

Summative client evaluation is a terminal, outcome-oriented assessment conducted at predetermined milestones, program completion, or hospital discharge. Summative evaluation synthesizes all quantitative and qualitative functional data to evaluate the overall extent of goal achievement, functional independence gains, and readiness for transition or community re-entry.

Clinical Purposes of Summative Evaluation

1. Goal Attainment Verification: Determining whether the client met the specific criteria established in their Individualized Treatment Plan (ITP) behavioral objectives (e.g., "Client will independently demonstrate 3 deep-breathing coping strategies during high-stress scenarios in 4 of 5 trials").
2. Quantification of Functional Change: Calculating delta scores ($\Delta = \text{Post-Score} - \text{Pre-Score}$) using standardized assessment instruments (such as the CERT-Psych, CERT-Phys Rehab, Leisure Diagnostic Battery, or CMS Section GG functional scores).
3. Interdisciplinary Care Coordination: Providing comprehensive functional outcome data to the interdisciplinary treatment team (physicians, physical therapists, occupational therapists, speech-language pathologists, social workers, case managers) to inform overall discharge planning.
4. Justification of Service Delivery: Providing third-party commercial payers, Medicare, and Medicaid with objective evidence of therapeutic value, functional recovery, and cost-effectiveness of RT services.
5. Long-Term Leisure Autonomy Planning: Formulating personalized post-discharge recommendations, home community recreation transition plans, and adaptive equipment prescriptions.

---

Formative vs. Summative Client Evaluation Comparison

---

Goal Attainment Scaling (GAS) in Clinical Practice

Goal Attainment Scaling (GAS) is a mathematically sound, individualized outcome measurement methodology originally developed by Thomas Kiresuk and Robert Sherman (1968). GAS is widely considered the gold standard in rehabilitation and mental health therapeutic recreation because it standardizes outcome measurement across clients with highly diverse diagnoses, baselines, and individualized goals.

The 5-Point Ordinal Metric

GAS establishes a 5-point ordinal scale for each individualized goal, ranging from -2 to +2, where 0 represents the expected, clinically targeted level of outcome achievement:

+-------------------------------------------------------------------------------------------------+
|                            GOAL ATTAINMENT SCALING (GAS) 5-POINT SCALE                          |
|                                                                                                 |
|   [-2] Much Less than Expected Outcome (Current baseline functioning or regression)             |
|     |                                                                                           |
|     v                                                                                           |
|   [-1] Less than Expected Outcome (Partial progress made; below target criterion)               |
|     |                                                                                           |
|     v                                                                                           |
|   [ 0] EXPECTED OUTCOME / TARGET OBJECTIVE (Clinically anticipated therapeutic achievement)     |
|     |                                                                                           |
|     v                                                                                           |
|   [+1] More than Expected Outcome (Exceeded target objective standard)                          |
|     |                                                                                           |
|     v                                                                                           |
|   [+2] Much More than Expected Outcome (Exceptional functional mastery far exceeding goals)     |
+-------------------------------------------------------------------------------------------------+

GAS Mathematical Foundations

When evaluating multiple goals simultaneously, individual goal scores can be aggregated into a standardized composite T-score using the Kiresuk-Sherman formula:

$T = 50 + \frac{10 \sum (w_i x_i)}{\sqrt{(1 - \rho) \sum w_i^2 + \rho \left( \sum w_i \right)^2}}$

Where:

• $w_i$ = weight assigned to goal $i$ (reflecting relative clinical priority, typically 1 to 3).
• $x_i$ = attainment score achieved for goal $i$ ($-2, -1, 0, +1, \text{ or } +2$).
• $\rho$ = expected inter-correlation between goal scores (conventionally set at $0.3$).

When a client achieves exactly the expected outcome ($x_i = 0$) across all weighted goals, the resulting overall T-score is 50.0 with a standard deviation of 10.0. Scores above 50 indicate overall performance exceeding expectations, while scores below 50 reflect below-expected progress.

---

Goal Attainment Scaling (GAS) Rubric Matrix

The following clinical matrix illustrates three fully operationalized GAS rubrics across physical rehabilitation, adult behavioral health, and pediatric neurodevelopmental RT domains:

---

Objective Measurement of Functional Change

To ensure scientific validity and defend medical necessity, the CTRS must utilize standardized measurement methodologies with proven psychometric properties.

1. Pre-Test / Post-Test Methodology

• Standardized Baseline Administration ($T_1$): Conducted during the initial assessment phase (typically within 24 to 72 hours of admission). Standardized tools—such as the Comprehensive Evaluation in Recreational Therapy (CERT), Leisure Competence Measure (LCM), or Functional Assessment of Characteristics for Therapeutic Recreation (FACTR-R)—are scored under controlled, objective conditions.
• Intervention Delivery: Protocol-driven RT sessions are administered with fidelity, tracking attendance, dosage, and in-session modifications.
• Standardized Terminal Administration ($T_2$): The exact assessment instrument is re-administered under identical conditions prior to discharge.
• Calculation of Functional Gain: Absolute Delta ($\Delta = T_2 - T_1$) and Relative Percentage Improvement are calculated: $\text{Percentage Change} = \left( \frac{T_2 - T_1}{\text{Max Possible Score} - T_1} \right) \times 100$

2. Minimal Clinically Important Difference (MCID)

Statistical significance does not always equate to meaningful functional improvement. The Minimal Clinically Important Difference (MCID) represents the smallest change in a standardized score that a patient or clinician perceives as beneficial and that justifies a change in clinical management. The CTRS must evaluate whether the client's post-test gains exceed the established MCID threshold for the specific instrument.

---

Clinical Decision-Making for Modifying, Continuing, or Discontinuing Interventions

Evaluation data serves as the clinical catalyst for four primary intervention decisions:

+-------------------------------------------------------------------------------------------------+
|                         CTRS CLINICAL DECISION-MAKING ALGORITHM                                 |
|                                                                                                 |
|                           [ EVALUATE OBJECTIVE CLIENT DATA ]                                    |
|                                          |                                                      |
|             +----------------------------+----------------------------+                        |
|             |                            |                            |                         |
|             v                            v                            v                         |
|   [ EXPECTED PROGRESS ]        [ BARRIER / DEFICIT ]        [ ACCELERATED MASTERY ]             |
|             |                            |                            |                         |
|             v                            v                            v                         |
|     ==> CONTINUE <==              ==> MODIFY <==              ==> PROGRESS <==                  |
|   Maintain current dosage,     Grade task down, adapt       Advance to higher functional        |
|   modality, and intervention   equipment, fade sensory      challenge, real-world context,      |
|   structure to completion.     stimuli, alter prompts.      or new behavioral objective.        |
|                                          |                                                      |
|                                          +----------------------------+                         |
|                                                                       |                         |
|                                                                       v                         |
|                                                          [ GOALS MET / PLATEAU / MMI ]          |
|                                                                       |                         |
|                                                                       v                         |
|                                                             ==> DISCONTINUE / <==               |
|                                                             ==>   DISCHARGE   <==               |
|                                                             Transition to community RT,         |
|                                                             home plan, or discharge.            |
+-------------------------------------------------------------------------------------------------+

1. Continuing the Intervention

• Indication: The client is demonstrating steady, quantifiable progress along the projected timeline toward target objectives (GAS score advancing from -2 toward 0).
• Action: Maintain current clinical protocol, therapeutic modality, session frequency, and facilitation style.

2. Modifying the Intervention

• Indication: The client is failing to make expected progress due to identifiable internal or external barriers (e.g., severe joint pain, attention deficits, activity anxiety, poorly fitted adaptive gear).
• Action: Formulate targeted adaptations: grade activity demands downward, introduce compensatory strategies, utilize sensory regulation breaks, or re-structure the prompting hierarchy.

3. Progressing the Intervention

• Indication: The client achieves target behavioral objectives significantly ahead of schedule (GAS score of +1 or +2).
• Action: Upgrade the functional challenge: transition from closed clinic settings to complex, unpredictable community environments; transition from 1:1 facilitation to group dynamics; or introduce higher-order cognitive and motor integration tasks.

4. Discontinuing the Intervention / Discharge Criteria

Interventions are discontinued and the client is discharged from RT services when specific clinical criteria are satisfied:

• Goal Attainment: The client has successfully mastered all short-term and long-term therapeutic recreation goals (all GAS scores $\ge 0$).
• Functional Plateau: The client has ceased to make measurable functional progress over a prolonged period (e.g., 3 consecutive evaluation cycles) despite documented protocol adjustments, grading changes, and multidisciplinary consultations.
• Maximum Medical Improvement (MMI) / Maximum Functional Benefit: The client has reached a functional ceiling where skilled restorative recreational therapy is no longer expected to yield further functional gains.
• Medical Instability or Transfer: Acute medical decompensation necessitating transfer to intensive medical units, or scheduled discharge from the healthcare facility.
• Client Self-Determination: The client or legal guardian withdraws consent or chooses to discontinue services.