19.2 Operant Conditioning, Reinforcement Schedules & Observational Learning

19.2 Operant Conditioning, Reinforcement Schedules & Observational Learning

Operant Conditioning (Skinnerian Paradigm)

Originating from Edward Thorndike's Law of Effect (behaviors followed by satisfying consequences are strengthened, whereas behaviors followed by noxious consequences are weakened), B.F. Skinner formalized operant conditioning—the learning process through which the probability of a voluntary, emitted behavior is modified by its consequences.

The Operant Contingency Matrix

Operant terms are defined strictly by functional behavioral outcomes, never by everyday colloquial value judgments:

• Reinforcement: Any consequence that increases or maintains the frequency of the preceding target behavior.
• Punishment: Any consequence that decreases or suppresses the frequency of the preceding target behavior.
• Positive (+): The addition, presentation, or administration of an environmental stimulus.
• Negative (-): The removal, subtraction, or termination of an environmental stimulus.

Subtypes of Negative Reinforcement: Escape vs. Avoidance Learning

Negative reinforcement frequently appears on the MCAT in the context of two distinct behavioral stages:

1. Escape Learning: The target behavior occurs while the aversive stimulus is currently present and actively experienced. The response functions to terminate, silence, or escape the ongoing noxious event. For example, jumping into a swimming pool to stop the physical discomfort of sweltering heat, or pressing a lever to turn off an electrified grid delivering footshocks.
2. Avoidance Learning: The target behavior occurs before the aversive stimulus begins, typically prompted by a predictive warning signal or discriminative stimulus. The response prevents the onset of the noxious event entirely. For example, leaving the house 30 minutes early upon hearing a traffic report warning of highway accidents, or stepping across a barrier when a warning tone sounds before an electrified grid activates.

Primary vs. Secondary Reinforcers & Token Economies

• Primary Reinforcers: Innately rewarding biological stimuli that satisfy fundamental physiological survival drives without prior learning (e.g., food, potable water, relief from cold, relief from physical pain).
• Secondary (Conditioned) Reinforcers: Previously neutral stimuli that acquire reinforcing properties through associative pairing with primary reinforcers (e.g., money, academic letter grades, gold stars, social praise).
• Token Economy: A formal behavioral modification system commonly deployed in psychiatric wards, rehabilitation facilities, and classrooms. Individuals receive conditioned reinforcers (tokens, plastic chips, points) contingent upon executing adaptive target behaviors. These tokens can subsequently be accumulated and exchanged for backup primary or valued secondary rewards (extra recreation time, private rooms, privileges).

Shaping & Extinction Dynamics

• Shaping: The operant procedure of training a complex, novel behavior by reinforcing successive approximations toward the ultimate target action while extinguishing earlier, less refined iterations. For example, training a pigeon to turn a complete 360-degree circle by first rewarding a slight head turn, then a quarter turn, then a half turn, until the full circle is executed.
• Extinction Burst: When a previously reinforced behavior is abruptly placed on extinction (all rewards discontinued), the organism temporarily exhibits a dramatic, paradoxical spike in the frequency, intensity, and variability of the unreinforced behavior before the response permanently declines. A classic human example is repeatedly hammering an elevator button when the elevator fails to arrive.

---

Schedules of Reinforcement

Operant behaviors can be reinforced continuously or intermittently (partially). Continuous Reinforcement (CRF) rewards every single correct emission of the behavior; it produces the fastest acquisition rate but extinguishes extremely rapidly once rewards cease. Intermittent (Partial) Reinforcement delivers rewards according to four fundamental schedules:

1. Fixed-Ratio (FR):
   • Contingency: Reinforcement is delivered after a predetermined, invariant number of correct responses (e.g., FR-5: every 5th lever press earns a food pellet; piecework factory pay).
   • Behavioral Profile: High response rate punctuated by a characteristic post-reinforcement pause—a brief hesitation immediately following reward delivery before high-speed responding resumes.
2. Variable-Ratio (VR):
   • Contingency: Reinforcement is delivered after an unpredictable, varying number of responses centered around an arithmetic mean (e.g., VR-20: rewards occur on average every 20 lever presses, but may occur after 2, 45, 12, or 21 presses).
   • Behavioral Profile: Generates the highest rate of responding of all four schedules and exhibits the greatest resistance to extinction. Operates without post-reinforcement pauses. This schedule accounts for the powerful, compulsive nature of slot machines, lottery tickets, and compulsive social media refreshing.
3. Fixed-Interval (FI):
   • Contingency: Reinforcement is provided for the first correct response emitted after a fixed, invariant duration of time has elapsed (e.g., FI-2 min: the first lever press after two minutes yields a pellet).
   • Behavioral Profile: Produces a distinctive scalloped response curve. Immediately following reward delivery, the response rate drops to near zero (post-reinforcement pause). As the designated time interval nears expiration, the response frequency accelerates steeply in anticipation of reward availability. Examples include cramming intensively right before a scheduled weekly exam.
4. Variable-Interval (VI):
   • Contingency: Reinforcement is provided for the first correct response emitted after an unpredictable, varying duration of time centered around an arithmetic mean (e.g., VI-5 min: reward intervals vary between 1, 8, 3, and 9 minutes).
   • Behavioral Profile: Produces a moderate, steady, continuous rate of responding without post-reinforcement pauses or scalloping. Resistance to extinction is remarkably high. Examples include unannounced pop quizzes or checking an inbox for unpredictable email arrivals.

---

Observational Learning (Social Cognitive Theory)

Pioneered by Albert Bandura, observational learning (social modeling) asserts that behavioral acquisition can occur indirectly through the observation and mental representation of another individual's actions, bypassing direct personal trial-and-error reinforcement.

The Bobo Doll Experiments (1961)

Bandura exposed young children to adult models interacting with an inflatable "Bobo doll":

• One group observed an adult model violently kicking, punching, and striking the doll with a mallet while shouting verbal insults.
• A control group observed an adult playing calmly with non-aggressive construction toys.
• When children were subsequently placed in a playroom containing attractive toys that were abruptly withheld (inducing mild frustration), children who observed the aggressive model spontaneously replicated the precise physical strikes and verbal abuse.
• Vicarious Reinforcement & Vicarious Punishment: When children observed the aggressive model receive praise and candy (vicarious reinforcement), aggressive imitation escalated; when the model was scolded or punished (vicarious punishment), spontaneous imitation declined. However, when offered rewards to demonstrate what the model did, both groups replicated the behaviors equally, demonstrating that learning had occurred cognitively regardless of whether it was immediately performed (the learning-performance distinction).

Bandura's Four Mediational Cognitive Processes

For observational learning to translate into behavioral execution, four sequential cognitive processes must occur:

1. Attention: The observer must actively focus on and perceive the model's behavior, influenced by the model's status, competence, and salience.
2. Retention: The observed actions must be encoded, organized, and stored in declarative or motor memory schemas for subsequent retrieval.
3. Motor Reproduction: The observer must possess the physical and cognitive capability to execute the stored mental representation.
4. Motivation: The observer must expect positive consequences or value the perceived outcome to initiate the behavior, driven by direct, vicarious, or self-reinforcement.

Neurobiological Basis: Mirror Neurons

Observational learning and empathy find neuroanatomical substrates in mirror neurons:

• Location: Concentrated within the premotor cortex, the supplementary motor area, and the inferior parietal lobule.
• Function: Mirror neurons fire action potentials both when an individual executes a specific goal-directed motor action (e.g., grasping an apple) AND when the individual simply observes another conspecific execute the identical goal-directed action.
• Implications: The mirror neuron system facilitates motor imitation, observational learning, emotional empathy, and theory of mind. Dysfunctions in mirror neuron circuits have been hypothesized to contribute to developmental motor coordination deficits and social communication impairments in autism spectrum disorders.