6.1 Schedules of Reinforcement & Schedule Thinning

Schedules of Reinforcement & Schedule Thinning

Exam Tip: The QASP-S exam requires rigorous fluency in distinguishing ratio from interval schedules, identifying characteristic cumulative record patterns (such as post-reinforcement pauses and interval scalloping), diagnosing ratio strain, and applying Herrnstein's Matching Law to bias clinical responding toward functionally equivalent replacement behaviors without relying on punitive interventions.

In Applied Behavior Analysis (ABA), a schedule of reinforcement is an environmental rule specifying the environmental conditions under which a specific response will produce reinforcement. Rather than occurring in a vacuum, every instance of reinforcement operates under either continuous or intermittent parameters. Understanding how schedule parameters dictate the frequency, rate, endurance, and topography of human behavior is one of the most critical responsibilities of a Qualified Autism Services Practitioner-Supervisor (QASP-S).

---

Continuous Reinforcement (CRF) vs. Intermittent Reinforcement (INT)

At the most fundamental level, reinforcement schedules are categorized along a continuum from continuous availability to intermittent availability:

Continuous Reinforcement (CRF / FR1)

Under a Continuous Reinforcement schedule (formally designated as Fixed Ratio 1 or FR1), every single occurrence of the target behavior produces reinforcement.

• Primary Clinical Purpose: Establishing new behaviors during initial skill acquisition, shaping novel verbal or motor topographies, teaching foundational communication exchanges (e.g., initial Picture Exchange Communication System [PECS] exchanges), and building instructional control.
• Clinical Limitations: CRF schedules are artificial and rarely mirror natural environments. Behaviors maintained on CRF exhibit rapid satiation on reinforcers and possess extraordinarily low resistance to extinction. If an instructor or caregiver abruptly stops delivering reinforcement for a CRF-trained response, responding typically ceases almost immediately after a rapid extinction burst.

Intermittent Reinforcement (INT)

Under an Intermittent Reinforcement schedule, only selected occurrences of the target response produce reinforcement. Intermittent reinforcement exists exclusively to transition newly mastered behaviors from artificial instructional environments into durable, naturally maintained behavioral repertoires.

• Primary Clinical Purpose: Maintaining established behaviors over extended time horizons, increasing behavioral endurance, and generating high resistance to extinction.
• The Paradox of Intermittent Reinforcement: Because the individual cannot predict precisely which specific response will yield reinforcement, responding persists across prolonged intervals in the absence of reinforcement—a phenomenon readily observable in both everyday human habits and clinical maintenance routines.

---

The Four Basic Intermittent Schedules

Intermittent schedules are organized across two orthogonal dimensions: Mechanism (Ratio vs. Interval) and Predictability (Fixed vs. Variable). Combining these two dimensions produces the four basic schedules of reinforcement.

                    ┌─────────────────────┬─────────────────────┐
                    │     FIXED (Fixed)   │  VARIABLE (Average) │
┌───────────────────┼─────────────────────┼─────────────────────┤
│ RATIO             │ Fixed Ratio (FR)    │ Variable Ratio (VR) │
│ (Count / Number)  │ Post-Reinforcement  │ High, steady rate;  │
│                   │ Pause; High rate    │ No pauses; Extreme  │
│                   │ between pauses      │ extinction resistance│
├───────────────────┼─────────────────────┼─────────────────────┤
│ INTERVAL          │ Fixed Interval (FI) │ Variable Interval   │
│ (Time Elapsed +   │ Scalloped pattern;  │ (VI)                │
│ 1st Response)     │ Slow post-pause,    │ Moderate, steady    │
│                   │ accelerates at end  │ rate; Stable        │
└───────────────────┴─────────────────────┴─────────────────────┘

1. Fixed Ratio (FR)

A Fixed Ratio (FR) schedule mandates that reinforcement is delivered contingent upon the completion of a predetermined, unvarying number of correct responses.

• Operational Specification: In an FR5 schedule, every fifth emission of the target response delivers the reinforcer (e.g., a student completes exactly 5 discrete math problems to earn 1 token).
• Cumulative Record Response Pattern: Produces a high rate of responding broken by a distinct post-reinforcement pause (PRP) immediately following the consumption of the reinforcer. Once responding resumes, it exhibits an all-or-none "run rate" until the ratio requirement is satisfied.
• Clinical Nuance: The duration of the post-reinforcement pause is directly proportional to the size of the ratio requirement: larger ratios generate longer pauses before the individual re-engages in the task.

2. Variable Ratio (VR)

A Variable Ratio (VR) schedule delivers reinforcement contingent upon the completion of a fluctuating number of responses that revolves around a designated mathematical average ($n$).

• Operational Specification: Under a VR5 schedule, reinforcement may be delivered after 3 responses, then 7 responses, then 2 responses, then 8 responses ($[3 + 7 + 2 + 8] / 4 = 5$). The learner cannot predict which specific response will contact the reinforcer.
• Cumulative Record Response Pattern: Generates the steepest, highest, and most consistent rate of responding of all basic schedules, completely devoid of post-reinforcement pauses. Responding is unbroken, rapid, and extraordinarily resistant to extinction.
• Everyday & Clinical Examples: Slot machines and gambling represent classic non-clinical VR schedules. Clinically, VR schedules are used to maintain high-rate social initiations (e.g., asking peers to play, where peers say "yes" intermittently) or fluent academic responding (e.g., flashcard sight-word reading).

3. Fixed Interval (FI)

A Fixed Interval (FI) schedule delivers reinforcement for the first correct response emitted after a fixed, unvarying period of time has elapsed.

• Crucial Clinical Distinction: An interval schedule does not deliver reinforcement automatically because time elapsed. The passage of time merely arms the contingency; the learner must actively emit the target behavior after interval expiration to contact reinforcement.
• Operational Specification: Under an FI 3-minute schedule, the first on-task response emitted after exactly 180 seconds have elapsed yields reinforcement. Responses emitted during the 180-second window produce no reinforcement.
• Cumulative Record Response Pattern: Produces the classic FI scallop. Immediately following reinforcement, responding drops to zero (post-reinforcement pause). As the end of the interval approaches, the response rate accelerates rapidly, forming a curved, scalloped trajectory on a cumulative graph.
• Everyday Example: Checking the clothes dryer or waiting for a bus operating on a strict 15-minute timetable. Individuals do not check the dryer immediately after starting it; checking behavior accelerates dramatically as the timer approaches completion.

4. Variable Interval (VI)

A Variable Interval (VI) schedule delivers reinforcement for the first correct response emitted after an unpredictable, varying interval of time has elapsed, revolving around a mathematical mean.

• Operational Specification: Under a VI 5-minute schedule, the required elapsed intervals might vary between 2 minutes, 7 minutes, 4 minutes, and 7 minutes, averaging 5 minutes.
• Cumulative Record Response Pattern: Generates a moderate, exceptionally steady, and uniform response rate with no post-reinforcement pauses and no scalloping. Because the individual cannot anticipate when the interval will lapse, continuous low-to-moderate vigilance is maintained.
• Clinical & Professional Examples: Periodic, unannounced fidelity check-ins by a QASP-S supervising an ABAT technician, or receiving unexpected text messages. Because the technician does not know when the supervisor will observe, high procedural integrity is steadily maintained throughout the shift.

---

Compound Schedules of Reinforcement

Clinical environments frequently involve complex interactions where multiple schedules operate concurrently or sequentially. The QASP-S must recognize seven primary compound schedules:

1. Concurrent Schedules (conc): Two or more independent schedules operate simultaneously and independently for two or more distinct behaviors. The learner exercises continuous choice regarding where to allocate responding. This schedule serves as the empirical foundation for Herrnstein's Matching Law.
2. Multiple Schedules (mult): Two or more basic schedules occur in an alternating, usually random sequence. Crucially, each component schedule is correlated with a distinct discriminative stimulus ($S^D$). For example, a student is on an FR2 schedule when working with Technician Sarah (signaled by a red folder) and on an FI 5-minute schedule when working with Teacher Davis (signaled by a blue folder).
3. Mixed Schedules (mix): Identical to multiple schedules with two or more alternating components, but no discriminative stimuli are present to signal which schedule is active. The individual must respond without environmental indicators regarding the prevailing schedule.
4. Chained Schedules (chain): Two or more basic schedules occur in a strict successive sequence. Completion of each initial schedule produces a conditioned reinforcer that serves simultaneously as the $S^D$ for the subsequent schedule component. Terminal unconditioned or backup reinforcement is delivered exclusively upon completion of the final link in the chain.
5. Tandem Schedules (tand): Identical to chained schedules with successive requirements, but without correlated discriminative stimuli between the components.
6. Alternative Schedules (alt): Provides reinforcement whenever the requirement of either a ratio schedule or an interval schedule is met first (e.g., alt FR20 FI 3-min: reinforcement occurs if 20 responses are completed OR if 3 minutes elapse and one response occurs, whichever happens first).
7. Conjunctive Schedules (conj): Mandates that the requirements of both a ratio schedule and an interval schedule must be satisfied before reinforcement is delivered (e.g., conj FR20 FI 3-min: the learner must engage in at least 20 responses AND at least 3 minutes must elapse before the response produces reinforcement).

---

Schedule Thinning Methodologies & Ratio Strain

Transitioning an autism intervention program from artificial continuous reinforcement to natural intermittent schedules requires systematic schedule thinning. Abrupt or haphazard reductions in reinforcement lead directly to treatment failure.

Clinical Thinning Protocols

• Ratio Thinning: Gradually increasing the number of responses required to contact reinforcement (e.g., progressing from FR1 $\rightarrow$ FR2 $\rightarrow$ FR3 $\rightarrow$ VR4 $\rightarrow$ VR6 $\rightarrow$ VR10). Increments should be modest (typically increasing requirements by no more than 20–30% per adjustment phase once mastery criteria are verified).
• Interval Lengthening: Systematically extending the duration of time required before a response is armed for reinforcement (e.g., FI 30s $\rightarrow$ FI 60s $\rightarrow$ VI 90s $\rightarrow$ VI 3-min).
• Visual & External Mediators: Utilizing token boards, contingency clocks, and progress bars provides conditioned visual feedback that buffers the behavioral effort during schedule thinning.

Ratio Strain: Definition, Indicators, and Remediation

Ratio strain is the behavioral breakdown that occurs when the response requirement is increased too rapidly or when the schedule becomes too lean relative to the learner's current behavioral repertoire.

Diagnostic Signs of Ratio Strain:

• Pronounced, elongated post-reinforcement pauses far beyond baseline levels.
• Emotional responding, frustration, crying, or verbal protest.
• Task avoidance, disengagement, and motor elopement from the instructional area.
• Resurgence of target problem behaviors (e.g., aggression, property destruction, self-injury) historically maintained by demand escape.

Clinical Remediation Protocol:

When ratio strain occurs, the QASP-S must never attempt to force compliance on the thinned schedule, as this exacerbates escape-maintained problem behaviors. The practitioner must:

1. Immediately drop the ratio back to the dense, previously mastered reinforcement schedule where the learner demonstrated fluent, unhesitating responding (e.g., immediately drop from FR10 back to FR3).
2. Re-establish behavioral momentum and high contact with reinforcement.
3. Re-initiate schedule thinning at substantially smaller, gradual mathematical increments (e.g., FR3 $\rightarrow$ FR4 $\rightarrow$ FR5) while monitoring response latency and affective indicators.

---

Herrnstein's Matching Law

Formulated by Richard Herrnstein in 1961, the Matching Law is a quantitative behavioral principle governing concurrent schedules. It states that the relative rate of responding allocated to two or more concurrent options matches the relative rate of reinforcement obtained from those options.

Mathematical Formulation

$\frac{B_1}{B_1 + B_2} = \frac{R_1}{R_1 + R_2}$ Where:

• $B_1$ and $B_2$ represent the rates of behaviors 1 and 2.
• $R_1$ and $R_2$ represent the rates of reinforcement obtained for behaviors 1 and 2.

The Four Determinants of Reinforcer Value

Response allocation is not governed by reinforcement rate alone. Herrnstein's framework encompasses four interacting variables:

1. Rate: How frequently reinforcement is delivered.
2. Magnitude / Quality: The volume, intensity, or individualized preference value of the reinforcer.
3. Immediacy (Latency): How rapidly reinforcement follows the emission of the response.
4. Response Effort: The physical or cognitive energy required to emit the behavior.

Clinical Application to Functional Replacement Behaviors

In autism behavior intervention plans, problem behavior (e.g., physical aggression) and an alternative communication response (e.g., exchanging an AAC icon) operate on concurrent schedules. If aggression produces immediate, high-magnitude caregiver attention on an FR1 schedule while the AAC exchange produces delayed attention on an FR5 schedule with high effort, the Matching Law dictates that the client will allocate responding almost exclusively to aggression.

To remediate this without harsh punishment, the QASP-S engineers the matching equation:

• Place the problem behavior on extinction ($R_{\text{problem}} = 0$) or make it exceedingly effortful.
• Provide dense, immediate, high-magnitude, low-effort reinforcement for the functional replacement behavior ($R_{\text{replacement}}$ maximized on CRF/FR1). The client mathematically reallocates responding to the functional alternative.

---

Comparison of the Four Basic Intermittent Schedules