13.3 SME Selection, Credible Sources and Validation
Key Takeaways
SME selection considers current task expertise, source familiarity and review availability.
Primary sources must be checked for edition, scope and completeness.
Validation includes lessons, summaries, job aids and quiz keys together.
Subject Matter Expert (SME) Collaboration Protocols
Safety instructional designers rarely possess deep operational expertise across every technical craft. Developing accurate courseware requires close collaboration with Subject Matter Experts (SMEs)—such as master electricians, millwrights, chemical operators, and reliability engineers.
Identify Target SME (Field Performer vs. Technical Authority)
│
├─► Conduct Cognitive Task Analysis (CTA) / Critical Incident Interview
│
├─► Extract Tacit Knowledge & Real-World Failure Modes
│
├─► Draft Courseware / Job Aid (Translate Jargon into Actionable Steps)
│
└─► Cross-Functional Sign-Off Matrix (Resolve "Work-as-Imagined" vs. "Work-as-Done")
Navigating the "Curse of Knowledge"
Highly tenured SMEs frequently suffer from the curse of knowledge—they execute complex cognitive tasks automatically without conscious awareness of individual sub-steps. An expert millwright might say, "You just listen to the bearing and adjust the tension until it feels right." The CIT's role is to deconstruct this tacit knowledge through structured Cognitive Task Analysis (CTA):
- Probe Sensory Cues: "What specific sound indicates misalignment? A high-pitched whine or a rhythmic rumble?"
- Probe Decision Triggers: "What exact gauge reading tells you the tension is unacceptable?"
- Critical Incident Technique: Ask the SME to recount the last near-miss or equipment failure: "What mistake did an inexperienced technician make, and what early cue did they overlook?"
Technical Content Validation and Resolving "Work-as-Imagined" vs. "Work-as-Done"
Before courseware or job aids reach the field, they must undergo formal multi-disciplinary validation using a structured sign-off matrix:
| Functional Reviewer | Primary Validation Focus | Critical Evaluation Question |
|---|---|---|
| Frontline Operations SME | Usability and practical executability | Can a technician follow these steps wearing full PPE under typical plant lighting and noise? |
| Design / Process Engineering | Equipment safety boundaries and operating limits | Do these procedural steps align with equipment design ratings, pressure reliefs, and interlocks? |
| Environmental, Health & Safety | Regulatory compliance and hazard controls | Does the document satisfy OSHA, EPA, and consensus safety standards (ANSI, NFPA)? |
| Maintenance / Reliability | Tooling specifications and component wear | Are specified torque values, lubricants, and isolation points mechanically accurate? |
Reconciling Operational Discrepancies
During validation reviews, CITs frequently uncover stark divides between "Work-as-Imagined" (the written engineering procedure on the corporate server) and "Work-as-Done" (how frontline operators actually perform the task). For instance, operators may bypass an isolation valve because the physical handle is corroded or obstructed.
Note
A safety trainer must never resolve operational discrepancies by simply teaching workers to follow unexecutable written procedures, nor by endorsing unauthorized informal workarounds. The CIT acts as a facilitator, bringing Engineering, Safety, and Operations together to eliminate the physical barrier—such as re-piping the valve or installing a permanent platform—so that the approved procedure matches safe field execution.
Selecting and coordinating subject matter experts
Select the SME from the actual technical requirement. Consider current task experience, relevant qualification, familiarity with the governing source, ability to explain decisions and availability for review. A highly experienced performer can describe work-as-done, while a technical or regulatory owner can validate the approved requirement. The project may need both. A prominent credential or job title does not automatically establish competence in the selected equipment or procedure.
Explain the review request concretely: identify the objective, learner audience, draft version, questions to resolve and response date. Give the SME the assessment as well as the instructional text. An explanation can be correct while its quiz key is wrong, or a checklist can omit a critical action that appears in the manual. Assign responsibility for reconciling comments rather than sending a draft to several people without an owner.
Evaluating credible information
Use primary sources for rules, sponsor policies and equipment instructions. Check publisher, edition, date, scope and whether the content is complete. A search snippet, vendor marketing page or old course handout may help locate a source but cannot establish a current regulatory obligation. Separate a legal requirement, an interpretation, a consensus recommendation and a company choice.
Maintain a reference record linking each important claim to its source and review date. If two sources differ, determine whether they concern different jurisdictions, equipment, editions or circumstances. Do not average conflicting numeric limits or select the convenient one. Escalate the issue to the appropriate owner and withhold the affected release until resolved.
| Review stage | Concrete question |
|---|---|
| Source check | Is this the applicable, current and complete authority? |
| Technical check | Does the explanation preserve the source's conditions and exceptions? |
| Instructional check | Can the intended audience use it correctly? |
| Assessment check | Does the key or criterion match the taught requirement? |
| Release check | Have blocking comments been resolved and approved? |
A useful comment record states the disputed passage, proposed change, rationale, source and disposition. Record why a comment was accepted, modified or rejected. Agreement should resolve the evidence rather than conceal dissent. After revisions, check related diagrams, job aids, summaries and quizzes so that one corrected paragraph does not leave contradictory instructions elsewhere.
Reviewing summaries and keys together
A technical correction must reach every place the claim appears. Review the lesson, diagram, job aid, summary, takeaways and assessment explanation together. If a timer is removed from the lesson but retained in a quiz key, the learner still receives contradictory guidance.
A final review should check that source links resolve to the intended authority and that the source actually supports the claim. Preserve the date and edition used, and set a responsible owner for later updates. Source quantity is less useful than a clear claim-to-evidence relationship.
Key takeaways
- SME selection considers current task expertise, source familiarity and review availability.
- Primary sources must be checked for edition, scope and completeness.
- Validation includes lessons, summaries, job aids and quiz keys together.
Two sources supply different equipment limits. What should the developer do?
Check scope and editions and obtain an authoritative resolution before release.
Average the limits to create a compromise.
Select whichever makes the exercise faster.
Treat a search snippet as conclusive regardless of the complete source.
Sections you finish are checked off in the contents.