1.1 Problem-Solving Models & Problem Identification

Problem-Solving Models & Problem Identification

In contemporary school psychology, data-based decision making is not an isolated clinical event; it is the foundational mechanism that permeates all aspects of professional practice (NASP Practice Model Domain 1). School psychologists utilize systematic problem-solving frameworks to identify academic and behavioral discrepancies, design targeted evidence-based interventions, and evaluate student outcomes. Rather than relying on intuition or unstandardized impressions, practitioners operate as scientific problem solvers who methodically isolate alterable instructional variables.

---

The 4-Stage Problem-Solving Model

Originating from behavioral consultation models (Bergan & Kratochwill, 1990) and popularized through systems-level problem-solving frameworks (such as the Heartland AEA model), the 4-stage problem-solving model provides a recursive, structured decision-making pipeline.

  [Stage 1: Problem Identification]
      "What is the discrepancy?"
                 │
                 ▼
  [Stage 2: Problem Analysis]
      "Why is it happening?" (RIOT / ICEL)
                 │
                 ▼
  [Stage 3: Plan Implementation]
      "Evidence-based intervention & fidelity"
                 │
                 ▼
  [Stage 4: Plan Evaluation] ──(Goal Not Met: Modify)──┐
      "Did the plan work?"                            │
                 │ (Goal Met: Fade/Generalize)        │
                 ▼                                    ▼
            [Success]                     [Re-analyze / Redesign]

The Problem Analysis Phase: Alterable vs. Non-Alterable Variables

A critical tenet of problem analysis is distinguishing between alterable variables and non-alterable variables:

• Alterable Variables: Factors within the school's direct sphere of influence that can be actively modified to improve outcomes. These include instructional pacing, curriculum difficulty, opportunities to respond (OTR), corrective feedback protocols, classroom seating arrangements, reinforcement schedules, and adult attention.
• Non-Alterable Variables: Historical or demographic factors that the school team cannot change, such as family socioeconomic status (SES), genetic predispositions, previous adverse childhood experiences (ACEs), or historical grade retention.

Praxis Core Concept: An intervention hypothesis must always center on alterable variables. Hypotheses attributing academic failure to "home life" or "low cognitive potential" are diagnostically invalid because they provide no actionable pathways for educational intervention.

---

The RIOT / ICEL Assessment Matrix

To conduct a comprehensive, ecologically valid problem analysis, school psychologists employ the RIOT by ICEL matrix. This multi-method, multi-source framework systematically crosses four distinct assessment procedures (RIOT) across four instructional and environmental domains (ICEL).

The organizing philosophy behind ICEL is hierarchical: school psychologists must systematically examine Instruction, Curriculum, and Environment before concluding that the source of difficulty resides intrinsically within the Learner.

             Instruction ──► Curriculum ──► Environment ──► Learner
                  │               │               │            │
  Review ─────────┼───────────────┼───────────────┼────────────┤
  Interview ──────┼───────────────┼───────────────┼────────────┤
  Observe ────────┼───────────────┼───────────────┼────────────┤
  Test ───────────┴───────────────┴───────────────┴────────────┘

The ICEL Domains (The "Where" and "What")

1. Instruction (I): The pedagogical delivery of content. Includes teacher pacing, explicit modeling (I Do, We Do, You Do), rate of opportunities to respond (OTR; recommended 3–5 per minute during direct instruction), immediacy and quality of corrective feedback, and active student engagement.
2. Curriculum (C): The educational materials and scope/sequence. Includes readability level, developmental appropriateness, pacing of curricular standards, prerequisite conceptual demands, and alignment with student mastery.
3. Environment (E): The physical and psychosocial setting. Includes classroom layout, noise levels, lighting, temperature, peer interactions, transition routines, behavioral expectations, and teacher praise-to-correction ratios (recommended minimum 4:1).
4. Learner (L): The individual student's intrinsic traits. Includes prior knowledge, motivation, language proficiency (BICS vs. CALP), executive functioning, physical health, hearing/vision acuity, and emotional state. The Learner domain is investigated only after ecological factors are ruled out.

The RIOT Procedures (The "How")

1. Review (R): Examining existing permanent products and educational artifacts (cumulative folders, prior attendance logs, discipline referrals, report cards, vision/hearing screenings, previous interventions).
2. Interview (I): Gathering qualitative perspectives from key stakeholders (teachers, parents/caregivers, the student, related service providers) using structured or semi-structured interview protocols.
3. Observe (O): Conducting systematic direct observation (SDO) in the natural environment using standardized methods (momentary time sampling, partial interval recording, antecedent-behavior-consequence [ABC] logging).
4. Test (T): Administering curriculum-based measurements (CBM), brief experimental analyses (BEA), diagnostic skill probes, or criterion-referenced inventories.

Complete RIOT / ICEL Diagnostic Matrix

---

Formulating Operational Definitions of Target Behaviors

Before collecting data or calculating discrepancies, the school psychologist must formulate an operational definition of the target behavior. An operational definition is an explicit, objective description that delineates precisely what the behavior looks like and what it does not look like.

Criteria for Valid Operational Definitions

1. Objectivity: The description references only observable aspects of the behavior (motor actions, audible utterances) rather than unobservable internal states (e.g., "anger," "disrespect," "anxiety").
2. Clarity: The definition is sufficiently unambiguous that an outside observer unfamiliar with the student could read the definition and accurately record the behavior without coaching.
3. Completeness: The definition establishes clear boundary conditions, specifying onset (what initiates the behavior episode) and offset (what terminates the behavior episode).
4. The "Dead Man's Test" (Ogden Lindsley): If a dead man can do it, it is not a behavior. For example, "sitting quietly," "not talking," or "staying in seat" fail the Dead Man's Test because a corpse can perform all of them. Target replacement behaviors must be framed as active, observable motor actions (e.g., "recording notes in workbook," "raising hand and waiting to be acknowledged").

Dimensions of Behavior

Depending on the clinical question, behavior is quantified across six distinct dimensions:

• Frequency / Rate: The total count of behavior occurrences per standard unit of time (e.g., calling out 8 times per 30-minute independent work period; rate = 0.27 call-outs/minute).
• Duration: The total elapsed time from the onset of a behavior to its offset (e.g., tantrums lasting an average of 14 minutes).
• Latency: The time elapsed between the presentation of an instructional prompt (antecedent) and the student's initiation of the response (e.g., taking 3.5 minutes to open a textbook after teacher instruction).
• Inter-Response Time (IRT): The time elapsed between two consecutive instances of the same behavior (e.g., 45 seconds between aggressive outbursts).
• Intensity / Magnitude: The physical force or severity of the behavior (e.g., volume of voice measured in decibels, or severity of property destruction rated on a validated scale).
• Topography: The physical form, shape, or motor sequence of the behavior (e.g., throwing pencils overhand vs. dropping them to the floor).

Comparison: Subjective Language vs. Operational Definitions

---

Gathering Baseline Data & Calculating Discrepancy Ratios

Baseline Stability Rules

A baseline establishes the pre-intervention performance level against which all future growth is evaluated. To ensure data stability:

• A minimum of 3 to 5 baseline data points must be collected across distinct sessions/days.
• The baseline must demonstrate stability: absence of extreme variability and no trend in the direction of intended intervention improvement.
• Caution: If a baseline exhibits a trend in the desired direction (e.g., student reading fluency is spontaneously improving without intervention), do not introduce an intervention; continue monitoring. If the baseline exhibits a deteriorating trend (e.g., severe self-injury escalating), immediate intervention is ethically warranted without waiting for extended baseline data.

Calculating Discrepancy Ratios

A discrepancy ratio quantifies the magnitude of the performance gap between the target student and peer or developmental benchmark expectations.

Formula 1: For Behaviors to Increase (Academic Skills, On-Task Behavior)

When higher values represent desirable performance (e.g., Words Correct Per Minute, Math Digits Correct, On-Task Percentage):

$$\text{Discrepancy Ratio} = \frac{\text{Expected Peer Benchmark / Norm Level}}{\text{Current Student Performance Level}}$$

Formula 2: For Behaviors to Decrease (Disruptions, Aggression, Off-Task Behavior)

When lower values represent desirable performance (e.g., Disruptive Outbursts, Tantrum Duration, Call-Outs):

$$\text{Discrepancy Ratio} = \frac{\text{Current Student Performance Level}}{\text{Expected Peer Benchmark / Norm Level}}$$

Clinical Interpretation of Discrepancy Ratios

There is no federal cut point for a discrepancy ratio. Problem-solving models such as the Heartland (Iowa) approach treat a ratio of about 2.0 or more as a significant discrepancy that warrants intensive problem analysis. The lower bands below are an illustrative local convention, not a legal standard:

• Discrepancy Ratio = 1.0: Student performance matches peer/benchmark expectations (No discrepancy).
• Discrepancy Ratio = 1.1 to 1.4: Mild discrepancy. Typically addressable through Tier 1 differentiated core instruction.
• Discrepancy Ratio = 1.5 to 1.9: Moderate discrepancy. The student performs substantially below peers (or exhibits nearly double the problem behavior). Strong candidate for Tier 2 targeted intervention.
• Discrepancy Ratio ≥ 2.0: Severe discrepancy. The student performs at less than half the rate of peers (or exhibits double or more the problem behavior). Signals a significant gap that calls for intensive problem analysis, more intensive intervention, and, when a disability is suspected, consideration of a comprehensive evaluation.

---

Setting Ambitious, Measurable Intervention Goals

Intervention goals must be ambitious, socially valid, and mathematically derived. Setting an arbitrary goal undermines data-based evaluation.

The Goal-Setting Formula

$$\text{Target Goal} = \text{Baseline Median} + (\text{Target Rate of Improvement [ROI]} \times \text{Number of Instructional Weeks})$$

Where:

• Baseline Median: The middle value of the 3 to 5 baseline assessment scores.
• Target ROI: The weekly growth rate derived from published normative growth tables (e.g., Fuchs & Fuchs weekly gain norms, Hasbrouck & Tindal reading fluency norms) or local peer growth rates.
• Instructional Weeks: The anticipated duration of the intervention cycle (typically 8 to 12 weeks).

Target Goal
    ▲
    │                                              ● (Target Goal: 46 WCPM)
    │                                            ▲
    │                                           ╱
    │                                          ╱  Aimline (Slope = 1.2 WCPM/wk)
    │                                         ╱
    │                                        ╱
    │    ● 36                               ╱
    │      ● 34 (Median Baseline = 36)     ╱
    │    ● 38                             ╱
    │  ──────────────────────────────────┴─────────────────────────►
       Baseline (3-5 pts)                   Week 8 (Intervention Horizon)

---

Case Vignette: Applying the Model in Practice

Student: Marcus, 3rd grade.
Referral: Teacher states, "Marcus is defiantly off-task, avoids all reading tasks, and distracts classmates during independent reading."

Stage 1: Problem Identification

• Operational Definition: During independent silent reading, off-task behavior is defined as Marcus looking away from his reading text for longer than 10 consecutive seconds, whispering to peers, tapping writing utensils on desk surfaces, or walking around the room. Onset: 10 seconds without eyes on text; Offset: eyes on text for 10 consecutive seconds.
• Baseline Data: Systematic 15-minute momentary time sampling (10-second intervals) across 3 days reveals Marcus is on-task an average of 32% of intervals, compared to peer average of 84%. $$\text{Discrepancy Ratio (Off-Task)} = \frac{100\% - 32\%}{100\% - 84\%} = \frac{68\%}{16\%} = 4.25$$
• Academic CBM Baseline: Administered 3 grade-level DORF probes: 34, 38, 36 WCPM. Median = 36 WCPM. Peer 3rd-grade winter benchmark = 86 WCPM. $$\text{Discrepancy Ratio (Reading)} = \frac{86 \text{ WCPM}}{36 \text{ WCPM}} = 2.39$$

Stage 2: Problem Analysis (RIOT / ICEL)

• Instruction (I): Teacher delivers whole-group phonics lecture with minimal active student responding (OTR = 0.4 per minute). No guided practice.
• Curriculum (C): Independent reading text is at a 4th-grade readability level (Lexile 740L). Marcus's instructional reading level is late 1st grade (Lexile 280L). The curriculum is at a frustrational level (>10% word recognition errors).
• Environment (E): Marcus sits at a pod table adjacent to high-achieving, fast-reading peers who frequently whisper and laugh.
• Learner (L): Phonics diagnostic probe indicates severe phonemic decoding deficits (vowel teams and r-controlled vowels).
• Hypothesis: Marcus's off-task disruptive behavior is maintained by negative reinforcement (escape) from a frustrational-level curriculum, exacerbated by low instructional OTR and a lack of explicit decoding instruction.

Stage 3: Plan Implementation

• Match curriculum to instructional level (controlled decodable text).
• Implement explicit, multi-component reading intervention (repeated reading with choral modeling, incremental rehearsal of high-frequency words).
• Alter environment: Move seat to a front-row pair with a supportive peer.
• Goal: Increase DORF from 36 WCPM to 50 WCPM over 10 weeks (Target ROI = 1.4 WCPM/week).

Stage 4: Plan Evaluation

Weekly CBM progress monitoring data charted against the aimline demonstrated that Marcus reached 54 WCPM at Week 10 (exceeding the aimline), while his classroom on-task engagement rose from 32% to 78%.