3.2 Calibrating the Seven-Point Effectiveness Scale
Key Takeaways
- The official sample explanations frequently accept adjacent ratings, showing that judgment should be calibrated rather than forced into extremes.
- A response can be somewhat useful yet incomplete, or somewhat unhelpful without being maximally harmful.
- Scale calibration should come from the published scenario explanations, not an invented hidden scoring algorithm.
Read the scale as ordered judgments
The SJT scale runs from 1, Very Ineffective, through 4, Neutral, to 7, Very Effective. The official answer explanations do not pretend that every workplace action has a single mechanically exact value. In the published scenarios, experienced Uniformed Division Officers often describe an action as deserving a range such as 5 or 6, 4 or 5, 3 or 4, or 1 or 2.
That pattern provides a useful lesson: first decide the direction of effect, then decide its strength.
- 1–3: the action is ineffective to some degree.
- 4: neutral or near the boundary between helping and not helping.
- 5–7: the action is effective to some degree.
The descriptive labels distinguish slight, moderate, and very strong effects. Do not treat 4 as a safe default, and do not treat 1 and 7 as mandatory proof of decisiveness.
Separate relevance from completeness
A response may be relevant but incomplete. In the official restricted-area protest scenario, simply telling the protester to leave is judged somewhat effective, while explaining that protest may continue outside the restricted area is judged more effective. Both address the immediate need to clear the area, but the second response better resolves the person's concern.
A response may also sound polite without solving the problem. In the official checkpoint-delay scenario, assuring an impatient aide that officers are moving as fast as possible is only somewhat ineffective to neutral. It acknowledges frustration but does not clearly explain the security process or create a workable next step. Courtesy alone does not guarantee effectiveness.
Distinguish mild weakness from active harm
Use the lower end when an action directly escalates, dismisses, or undermines the response. The official protest example rates warning a person to stop raising her voice at 1 or 2. The warning focuses on irritation rather than the actual restricted-area issue and is likely to intensify resistance.
A 3 or 4 response is different. It may be understandable, tangential, or incomplete without creating the strongest harm. In the fatigue example, telling a tired officer that long hours are sometimes part of the job is judged 4 or 5; telling the officer to walk around is judged 3 or 4. Neither is treated as a catastrophic act. One offers acknowledgement, while the other supplies a limited tactic but misses the underlying need to address severe fatigue with supervision.
Avoid absolute policy claims
The official samples reveal judgment tendencies in those scenarios, not universal post orders. Do not convert a sample into a rule such as "always escalate to a supervisor," "never acknowledge emotion," or "every security explanation is a 7." The effectiveness of an action depends on the facts in the video and the exact wording of the response.
Similarly, the public guide does not reveal:
- A distance-from-key scoring formula.
- Positive or negative point values for adjacent ratings.
- Automatic penalties for using too many middle or extreme ratings.
- A requirement that ratings follow a statistical distribution.
Prepare to judge behavior, not to game an undisclosed algorithm.
A repeatable calibration method
For each response:
- Name the objective. What problem is the officer trying to solve?
- State the action's immediate effect. Does it advance the objective, obstruct it, or leave it unchanged?
- Check secondary effects. Does the wording preserve professionalism, communicate useful information, or create needless friction?
- Judge completeness. Does it fully address the issue or only one part?
- Choose a label, then its number. Decide "slightly effective" before selecting 5, rather than picking a number and inventing a justification.
Adjacent-rating practice
Suppose an action clearly helps but omits a useful explanation. That points toward 5, Slightly Effective, rather than 7. If it directly addresses the problem and adds information that makes cooperation more likely, 6 or 7 may fit. If it provides no clear improvement but causes no meaningful harm, 4 may fit. If it redirects attention away from the issue or adds friction, move below 4, with the depth of harm determining how far.
The official explanations sometimes accept adjacent values because real judgment has gradations. Your goal is consistent reasoning from the scene, not false precision.
Use the Memory link
Calibration begins with accurate viewing. Who made the request? What reason did the person give? What restriction or staffing fact was stated? These details affect effectiveness and later become possible Memory Skills material. If you cannot summarize the conflict in one sentence, replay before rating while the official directions still allow it.
A strong candidate can defend a rating in plain language: "This is moderately effective because it addresses the restriction and offers a lawful alternative, though it does not explain why cooperation matters." That explanation shows direction, strength, and completeness without claiming knowledge the public guide never supplies.
What do the official sample explanations imply about use of the seven-point SJT scale?