3.1 Standardized & Non-Standardized Assessment Administration

Standardized & Non-Standardized Assessment Administration

Evaluation is the cornerstone of occupational therapy practice. It establishes a client's baseline functional status, identifies occupational performance limitations, and provides the quantitative and qualitative foundation for goal development and intervention planning. In occupational therapy, evaluation is a collaborative, ongoing process governed by strict professional standards established by the American Occupational Therapy Association (AOTA) and the Accreditation Council for Occupational Therapy Education (ACOTE).

While the Occupational Therapist Registered (OTR) is legally and ethically accountable for the entire evaluation process—including tool selection, score interpretation, and goal formulation—the Certified Occupational Therapy Assistant (COTA) plays a vital role in data collection, administering delegated screening tools, and recording standardized assessment scores once service competency has been demonstrated.

1. Professional Roles: OTR vs. COTA in Evaluation & Assessment

The division of responsibilities between the OTR and COTA during the evaluation and assessment process is clearly delineated by AOTA Standards of Practice and state licensure boards:

+-----------------------------------------------------------------------------+
|                  EVALUATION ROLES & PROFESSIONAL RESPONSIBILITIES           |
|                                                                             |
|   [OCCUPATIONAL THERAPIST (OTR)]              [CERTIFIED OT ASSISTANT (COTA)]|
|   • Initiates evaluation process              • Administers delegated tools |
|   • Selects specific assessment tools           after service competency    |
|   • Directs screening & data collection       • Gathers objective data,     |
|   • INTERPRETS all assessment data              measurements, & observations|
|   • Synthesizes data into Occupational Profile• Reports factual findings    |
|   • Establishes treatment goals & plan of care  to supervising OTR          |
|   • Determines need for service continuation  • CANNOT interpret scores     |
|     or discharge                                or establish goals alone    |
+-----------------------------------------------------------------------------+

Comparative Responsibilities in Assessment Administration

2. Service Competency: Definition & Verification Protocols

[!IMPORTANT] Definition of Service Competency: Service competency is the formal determination that two occupational therapy practitioners (the supervising OTR and the COTA) will achieve the same results when administering the same assessment, screening, or intervention procedure. It ensures testing fidelity, client safety, and clinical inter-rater reliability.

+-----------------------------------------------------------------------------+
|                   SERVICE COMPETENCY VERIFICATION PROTOCOL                  |
|                                                                             |
|   [STEP 1: REVIEW]      ---> Review test manual, administration scripts,    |
|                              scoring rubrics, and video exemplars.          |
|                                    |                                        |
|                                    v                                        |
|   [STEP 2: OBSERVATION] ---> COTA observes OTR administering the assessment |
|                              in a clinical setting; co-scoring session.     |
|                                    |                                        |
|                                    v                                        |
|   [STEP 3: SUPERVISION] ---> OTR directly observes COTA administering the    |
|                              assessment to 3 consecutive clients.           |
|                                    |                                        |
|                                    v                                        |
|   [STEP 4: CO-SCORING]  ---> Co-scoring achieves ≥90% inter-rater agreement  |
|                              across 3 consecutive trials.                   |
|                                    |                                        |
|                                    v                                        |
|   [STEP 5: DOCUMENT]    ---> Written documentation placed in personnel file;|
|                              annual re-verification / competency audit.     |
+-----------------------------------------------------------------------------+

Methods of Establishing Service Competency:

1. Direct Observation: The supervising OTR observes the COTA administering the test in real time, checking for strict adherence to scripted prompts, standardized physical setup, and timing.
2. Co-Scoring / Inter-Rater Reliability: The OTR and COTA independently score the same client during a live session or from a recorded video administration. A statistical agreement of ≥90% (or kappa coefficient $\kappa \ge 0.85$) across three consecutive trials is the widely accepted gold standard.
3. Videotape / Self-Assessment Review: The COTA videotapes their administration of an assessment for joint review and structured critique with the OTR.
4. Periodic Re-Verification: Service competency is not a one-time event; it must be re-evaluated annually, whenever an assessment manual releases updated standardized protocols, or when client populations change significantly.

3. Standardized vs. Non-Standardized Assessments

Assessments used in occupational therapy fall into two major categories: standardized and non-standardized. Understanding the clinical advantages, psychometric properties, and limitations of each is essential for COTA practice.

+-----------------------------------------------------------------------------+
|                     TAXONOMY OF ASSESSMENT INSTRUMENTS                      |
|                                                                             |
|   [STANDARDIZED ASSESSMENTS]                  [NON-STANDARDIZED TOOLS]      |
|   • Fixed administration protocols            • Flexible, dynamic structure |
|   • Scripted instructions & timing            • Adapts to natural contexts  |
|   • Established reliability & validity        • High ecological validity    |
|   • Yields quantitative scores                • Yields qualitative data     |
|        |                    |                      |                        |
|        v                    v                      v                        |
|   [NORM-REFERENCED]    [CRITERION-REFERENCED] [CLINICAL OBSERVATION,        |
|   Compares to peer     Compares to absolute   INTERVIEWS, CHECKLISTS]       |
|   normative sample     performance standard                                 |
+-----------------------------------------------------------------------------+

Detailed Comparison: Norm-Referenced vs. Criterion-Referenced Tests

4. Psychometric Properties: Reliability & Validity

Standardized assessments must exhibit rigorous psychometric properties to ensure that the data collected is trustworthy, repeatable, and clinically meaningful.

1. Reliability (Consistency & Precision)

• Inter-Rater Reliability: The degree of agreement between different evaluators administering the same assessment to the same client under identical conditions ($r \ge 0.80$ is acceptable; $r \ge 0.90$ is excellent).
• Intra-Rater Reliability: The consistency with which a single evaluator obtains the same results across multiple administrations with the same client.
• Test-Retest Reliability: The stability of assessment scores over time when administered to the same client on two separate occasions without intervention ($r \ge 0.80$).
• Internal Consistency: The degree to which all test items within a subscale measure the same underlying construct (commonly measured via Cronbach's alpha, $\alpha \ge 0.70$ to $0.90$).

2. Validity (Accuracy & Truthfulness)

• Face Validity: The subjective appearance that the test measures what it claims to measure (least rigorous).
• Content Validity: The extent to which test items comprehensively sample the domain of knowledge or functional behavior being evaluated.
• Criterion-Related Validity: How well assessment scores correlate with an established external standard or gold-standard measure:
  • Concurrent Validity: The test score correlates with an established gold-standard test administered at the same time.
  • Predictive Validity: The test score accurately predicts future functional outcomes (e.g., a Berg Balance score predicting future fall frequency).
• Construct Validity: The degree to which an assessment measures a theoretical, non-observable construct (e.g., fine motor dexterity, sensory modulation, cognitive processing).

5. Standardized Administration Protocol & Environmental Setup

Standardized tests require exact environmental and procedural fidelity. Any deviation from the published test manual introduces measurement error and compromises the validity of the resulting standard scores.

+-----------------------------------------------------------------------------+
|                   STANDARDIZED TESTING FIDELITY CHECKLIST                   |
|                                                                             |
|   [1. ENVIRONMENTAL CONTROLS]                                               |
|   • Quiet, well-lit testing room free from visual/auditory distractions.    |
|   • Ergonomic table & chair height: feet flat on floor, 90° elbow flexion.  |
|   • Standardized material layout: pegboards centered, test cards at midline.|
|                                                                             |
|   [2. VERBATIM SCRIPT FIDELITY]                                             |
|   • Read instructions exactly as printed in the manual; no paraphrasing.    |
|   • Provide only the permitted practice trials and demonstrations.          |
|   • Do NOT provide unauthorized encouragement ("Good job!", "Try harder!").|
|                                                                             |
|   [3. CHRONOMETRIC FIDELITY]                                                |
|   • Use a silent digital stopwatch; adhere strictly to subtest time limits. |
|   • Start and stop timing precisely at the manual's designated cues.        |
|                                                                             |
|   [4. ACCOMMODATION VS. MODIFICATION]                                       |
|   • Accommodation (glasses, hearing aids): Validates standard scores.       |
|   • Modification (extra time, translated cues): Invalidates standard scores;|
|     must report findings qualitatively/descriptively.                       |
+-----------------------------------------------------------------------------+

[!WARNING] Accommodation vs. Modification Impact:

• Accommodation: An environmental or personal adjustment that enables the client to access the test without altering what the test measures (e.g., client wears prescription eyeglasses, sits on a non-slip cushion). Standardized norm-referenced scores remain valid.
• Modification: A change to the administration protocol, instructions, or timing (e.g., providing verbal hints, allowing 60 seconds instead of 30 seconds). Standardized norm scores are invalidated and cannot be reported as normative percentiles; the COTA must document the performance descriptively as non-standardized qualitative data.

6. Objective vs. Subjective Data Collection & Recording Rigor

Accurate documentation requires strict differentiation between objective clinical data and subjective client reporting. COTAs must avoid diagnostic speculation or vague qualitative descriptions.

Objective vs. Subjective Comparison Table

7. Clinical Scenario: COTA Administering Standardized Testing

Clinical Case Vignette: A 9-year-old child with developmental coordination disorder (DCD) is referred for an outpatient occupational therapy evaluation. The supervising OTR has selected the Bruininks-Oseretsky Test of Motor Proficiency, Second Edition (BOT-2) to assess fine motor precision, fine motor integration, and manual dexterity. The COTA has previously established service competency on the BOT-2 with the OTR (scoring >92% inter-rater agreement across 3 videotaped pediatric sessions).

Assessment Administration & Data Collection Steps:

1. Preparation & Environmental Setup: The COTA arranges the pediatric clinic room to eliminate auditory distractions, adjusts the chair and table so the child's feet are flat on the floor with knees and hips at 90°, and places the BOT-2 testing kit within easy reach behind the examiner to prevent visual distraction.
2. Verbatim Script Administration: The COTA reads the standardized instructional prompts verbatim from the administration manual, provides the exact number of allowable practice trials, and observes the child's pencil grip and page stabilization without giving unstandardized verbal hints.
3. Chronometric Measurement: Using a digital stopwatch, the COTA times the manual dexterity tasks (e.g., placing pennies into a bank, sorting cards) to the exact second.
4. Objective Documentation & Handoff: The COTA calculates the raw numerical scores, notes behavioral observations (e.g., "Child switched pencil from right to left hand on item 4; maintained seated posture for 25 minutes without physical restlessness"), and immediately submits the completed test booklet and raw data to the supervising OTR.
5. Interpretation & Plan Formulation: The OTR reviews the raw data, converts scores into scaled scores and percentiles, interprets the clinical significance within the Occupational Profile, and establishes measurable therapy goals.