18.1 Writing Clear Items and Plausible Distractors

Written Test Construction: Multiple-Choice Item-Writing Best Practices & Distractor Quality

Anatomy of a Multiple-Choice Item

Every multiple-choice item consists of three structural elements:

1. The Stem: The introductory problem statement, operational scenario, or direct question.
2. The Keyed Response (The Key): The single unambiguously correct or best answer.
3. The Distractors: Plausible but incorrect alternative options designed to attract trainees who harbor specific misconceptions, lack comprehensive understanding, or rely on superficial guesswork.

Anatomy of a Psychometrically Defensible Safety Item:
+-----------------------------------------------------------------------------------------+
| Stem: Clear workplace scenario presenting a specific problem to solve                    |
+-----------------------------------------------------------------------------------------+
| Option A (Distractor): Plausible misconception based on common novice calculation error  |
| Option B (Distractor): Outdated standard requirement frequently confused by workers     |
| Option C (Keyed Correct Answer): Unambiguously correct regulatory / technical procedure   |
| Option D (Distractor): Action appropriate for general industry but wrong in construction |
+-----------------------------------------------------------------------------------------+

To assess higher-order cognitive functioning (Bloom's Taxonomy Level 3: Application and Level 4: Analysis), instructional trainers should utilize scenario-based item stems. Rather than asking for rote memorization of an OSHA standard number, the stem should present an authentic workplace scenario with realistic environmental conditions, worker behaviors, and equipment readings, requiring the candidate to apply safety principles to reach the correct decision.

Principles of Unambiguous Stem Construction

A well-crafted stem allows a knowledgeable trainee to anticipate the correct answer before examining the response options.

1. Present a Complete, Defensible Problem

The stem must contain sufficient context and clarity so that the examinee understands the exact question being asked. Stems consisting of an incomplete sentence ending in a hanging preposition or single noun (such as "Personal protective equipment is:") force trainees to read all options to infer the question's premise.

2. Default to Positive Phrasing

Humans process affirmative statements faster and with lower cognitive error rates than negative statements. Negative stems containing words such as "NOT," "EXCEPT," or "LEAST" introduce construct-irrelevant cognitive load.

3. Eliminate Extraneous "Window Dressing"

While workplace context is essential for scenario items, irrelevant technical details (such as the personal name of a fictional worker, their shift start time, or unrelated facility history) introduce reading fatigue without assessing safety knowledge. Keep scenario stems focused strictly on the operational variables necessary to solve the problem.

---

Distractor Quality: Plausibility and Error Typologies

The diagnostic power of a multiple-choice item resides almost entirely in the quality of its distractors. A question with three absurd or obvious distractors functions as a binary true/false question or an exercise in basic elimination.

Constructing Plausible Distractors

Effective distractors must reflect:

• Common novice misconceptions: Errors frequently observed during field walkthroughs, job task analyses, or classroom discussions.
• Rule overgeneralizations: Applying a safety rule that is correct in one environment (such as the general industry 4-foot fall protection trigger) to a distinct domain with different criteria (such as construction 6-foot trigger or scaffold 10-foot trigger).
• Calculation traps: Intermediate results in multi-step equations (such as calculating total weight of a rigging load without factoring in sling angle tension).
• Obsolete or colloquial practices: Legacy industry habits that have been superseded by modernized safety standards.

Ensuring Option Homogeneity

All response options—both the key and the distractors—must maintain mutual homogeneity:

• Grammatical consistency: Every option must complete the stem with flawless subject-verb and tense agreement.
• Equal length and detail: Untrained test writers frequently write long, detailed, heavily qualified correct answers while drafting short, abrupt distractors. Savvy test-takers instinctively select the longest, most nuanced option.
• Uniform numerical formatting: Numerical options should be arranged in ascending or descending sequence with identical units of measure.

---

Eliminating Flawed Item Construction and Test-Wiseness Traps

The following item-writing practices reduce avoidable clues and ambiguity. They are design guidance, not universal legal prohibitions.

Avoid "all of the above" and "none of the above" when they allow partial knowledge to reveal the key. Keep options grammatically parallel and similar in scope. Do not use "always" or "never" merely as clues; sometimes an applicable rule really is absolute. A correct answer should follow from knowledge of the task, not option length, wording patterns or guessable key positions.

Before-and-After Item Repair Tables

Repair example: incomplete scenario

Repair example: irrelevant detail

A task-analysis question does not need the worker's age, nationality or an unrelated machine serial number. Keep details that change the decision, such as a missing prerequisite or unavailable equipment. Remove decorative facts that add reading burden without measuring the objective.

Repair example: unsupported engineering detail

If a scenario needs an equipment limit, provide the current approved limit and identify it as supplied data. Do not invent a torque, voltage boundary or atmospheric clearance rule. The instructional question can ask how to select the correct reference or verify the prerequisite instead of testing an unsafe fabricated fact.

---

Key takeaways

• A multiple-choice item has a clear stem, a defensible key and plausible distractors.
• Include details that affect the decision and remove irrelevant reading burden.
• Item repair preserves valid premises rather than inventing engineering or regulatory facts.