20.2 Behavior Observations and Change Reporting

Designing Level 3 Observation Protocols and Behavioral Audits

Use structured workplace observations where appropriate, supplemented by supervisor reports and other relevant evidence. Define the behavior, eligible opportunities, observer preparation and privacy arrangements. Unstructured impressions are difficult to compare.

Observation quality

Define the actual approved action in observable terms. Prepare observers with common examples and compare ratings to resolve ambiguity. Choose any agreement target through the program's documented process; no universal 85% threshold is assumed. Plan suitable observations and note that being observed can affect behavior. Avoid covert or privacy-inappropriate monitoring, and interpret the findings with those limitations.

Example: behavioral observation record

Scheduling follow-up from task opportunities

A 30-, 60- and 90-day schedule can be an illustrative plan, but it is not a universal requirement or proof of habit formation. Choose follow-up from task frequency, risk, opportunity to perform and available evidence.

1. 30-Day Evaluation: Adoption and Opportunity to Perform

• Focus: Has the worker been assigned tasks requiring the trained skills? Have any immediate procedural friction points emerged?
• Action: First-line supervisors complete a 5-question behavioral verification check. If the employee has not performed the task within 30 days, rapid skill decay occurs. The supervisor must create deliberate practice opportunities.

2. 60-Day Evaluation: Consistency and Peer Norms

• Focus: Is the worker maintaining procedural adherence when direct supervisor presence is absent? How are work crew peers reacting to the newly trained methods?
• Action: Safety committee members and peer auditors perform unannounced behavioral sampling. Identify whether informal crew norms are supporting or undermining the new procedures.

Later follow-up

Check whether performance is maintained in relevant conditions and whether supervisors support the required behavior. If the task has not occurred, record the lack of opportunity rather than interpreting it as success or failure.

Diagnosing and Overcoming Transfer Barriers

When behavior does not transfer, investigate learner knowledge, course design and the work environment. Multiple causes may coexist. An instrument such as the Learning Transfer System Inventory can support analysis but is not a mandatory tool for every program.

Documenting behavior change

A change report needs a baseline, a clear behavioral definition, an appropriate follow-up and comparable opportunities. Record both the number of eligible observations and the number meeting the criterion. An increase from eight compliant observations out of ten to eighteen out of twenty is a change from 80% to 90%, not evidence that every employee improved. Small samples and changed task conditions limit interpretation.

Separate observation from inference. "The worker skipped the specified reference check on this observed task" is a factual record. "The worker does not value safety" is an interpretation requiring more evidence. Include relevant conditions such as unavailable materials or interrupted supervision, and identify corrective action rather than assigning a personality label.

Communicate the result to the responsible audience with suitable privacy protection. A supervisor may need the individual remediation status; a program reviewer may need aggregate patterns. Document the completed action and later evidence. If no task opportunity occurred, report that limitation and plan another check instead of entering a successful result by default.

A useful report links the objective, observed behavior, evidence, comparison period, limitations, action owner and next review. This makes behavior-change reporting actionable for both assessment follow-up and course evaluation.

Sampling relevant opportunities

Define when the trained behavior should occur before counting compliance. A worker who has no eligible task during follow-up should not be entered as either compliant or noncompliant by default. Record the absence of opportunity and plan another observation or suitable check. This is especially important for infrequent tasks, where a calendar date may arrive before any actual use.

Choose observation opportunities that represent the intended conditions without creating unnecessary exposure. A safe simulation can support readiness but should be labeled separately from workplace transfer. A supervisor's report can add context but needs a defined behavior and evidence source. Combining these perspectives is useful when the report preserves what each actually establishes.

If follow-up compares different sites, note procedure or equipment differences that affect interpretation. Apply common principles where valid, and use site-specific criteria where needed. An apparent difference in compliance may reflect different opportunities or definitions rather than different learning.

A report should state the sampling approach and important limitations, then identify the decision supported. The purpose is to improve performance and course support, not to create a favorable percentage by excluding difficult cases without explanation.

Key takeaways

• Behavior observations specify the action, opportunity, conditions and evidence.
• Change reports compare defined behavior under suitable conditions.
• Observation and inference are recorded separately with action ownership and follow-up.