9.2 How to Judge Effectiveness
Key Takeaways
- The Occupational Judgment Assessment measures Decision Making: making sound, well-informed and objective decisions, perceiving their impact and implications, and committing to action even in uncertain situations.
- Effective actions typically address the actual problem directly, use available resources, and keep the right people informed.
- Least effective actions typically ignore the problem, pass it to someone else without cause, act on assumptions rather than facts, or create a new problem.
- The Early Career Judgment Assessment uses an explicit five-point effectiveness scale that illustrates how OPM frames effectiveness.
- OPM's own advice is to answer honestly rather than to guess at an idealised response.
9.2 How to Judge Effectiveness
Quick Summary: The competency measured is Decision Making: makes sound, well-informed, and objective decisions; perceives the impact and implications of decisions; commits to action, even in uncertain situations, to accomplish organizational goals; causes change. Every clause in that definition is a criterion you can apply to a course of action.
What OPM's own effectiveness scale looks like
OPM publishes an explicit five-point effectiveness scale for the Early Career Judgment Assessment, and it is the clearest available statement of how OPM frames effectiveness in a judgment context:
| Rating | Definition |
|---|---|
| 1. Highly Ineffective | The response is not constructive in this situation and risks negative consequences. |
| 2. Ineffective | The response has limited value and does not address the situation well. |
| 3. Somewhat Effective | The response is reasonable in this situation, but the solution is incomplete or does not directly address the issue. |
| 4. Effective | The response is a useful action that directly addresses the situation in a constructive way. |
| 5. Highly Effective | The response is one of the best and most effective possible actions given the information provided. |
Read the middle rows carefully, because they define the boundary you will be judging.
Somewhat Effective is reasonable but incomplete, or does not directly address the issue. Effective is useful and directly addresses the situation. The dividing line is directness — whether the action engages the actual problem or works around its edges.
Highly Ineffective is not merely unhelpful; it risks negative consequences. That is your marker for the least effective option: look for the action that could make things worse, not just the one that achieves least.
Note too the closing phrase in the top row: given the information provided. Effectiveness is judged against what is known in the scenario, not against what an ideal actor with perfect information would do.
Characteristics of effective actions
Drawing the competency definition and the scale together:
Addresses the actual problem. Identify what the problem in the scenario really is. If a colleague missed a deadline because they did not know how to use a system, then training or help with the system addresses it; a reminder about deadlines does not.
Well-informed. Sound decisions rest on facts. Actions that gather relevant information before acting — asking a clarifying question, checking the record — usually score better than actions taken on assumption, provided information-gathering is not merely a way of postponing action.
Objective. Decisions rest on the situation rather than on personal preference or on who is involved.
Commits to action. The definition explicitly includes commits to action, even in uncertain situations. Options that do nothing, wait indefinitely, or hope the problem resolves itself are weak, and uncertainty is not a reason to avoid acting.
Perceives impact and implications. Strong actions consider consequences for others — the customer waiting, the colleague depending on the output, the deadline that follows.
Keeps the right people informed. Where an action affects others or exceeds what you can resolve, informing a supervisor or colleague is part of the effective response.
Characteristics of ineffective actions
The least effective option normally shows one of these patterns:
| Pattern | Example |
|---|---|
| Ignores the problem | Do nothing and hope it resolves |
| Avoids without cause | Pass the whole matter to someone else when you could handle it |
| Acts on assumption | Conclude a colleague is being careless without checking |
| Creates a new problem | Solve your issue by disrupting someone else's work |
| Risks negative consequences | Discuss a colleague's error with uninvolved staff |
| Addresses a symptom only | Fix today's error without addressing why it happened |
| Disproportionate escalation | Take a routine question straight to senior management |
The last row deserves a note. Escalation is not automatically good or bad — it depends on proportion. Escalating a matter you can resolve yourself is weak; failing to escalate something that genuinely exceeds your authority is also weak. Ask whether the level of response matches the size of the problem.
The two poles are usually clear
Because you select only the extremes, focus your effort there.
For the most effective, look for the option that directly addresses the actual problem, uses available information, and accounts for the people affected. On the five-point scale, you are looking for a 4 or 5.
For the least effective, look for the option that risks making things worse. On the scale, a 1 rather than a 2. If two options both seem weak, prefer the one with a negative consequence over the one that is merely unhelpful.
That distinction — harmful versus merely inadequate — is the most useful tiebreaker in the whole assessment.
Two false heuristics to avoid
"Always ask the supervisor." Deferring every decision upward contradicts commits to action and, in routine matters, is only somewhat effective at best. Involve a supervisor when the matter genuinely warrants it.
"Always choose the most thorough option." An action can be thorough and still miss the point, or be disproportionate to a small problem. Directness beats elaborateness.
And OPM's own advice
OPM's tips for this assessment are to read thoroughly, be honest, and stay true to yourself — don't overthink. The framework above is a way of thinking clearly about what would genuinely work, which is not the same as guessing at a scoring key. Where your considered judgement and a clever theory about "what they want" diverge, OPM's guidance points toward the former.
On OPM's published five-point effectiveness scale, what distinguishes a response rated Effective from one rated Somewhat Effective?
Two courses of action both seem weak: one achieves little, and the other could make the situation worse. Which is the better choice for LEAST effective?
Why is "always defer the decision to a supervisor" an unreliable strategy on the Occupational Judgment Assessment?