1.3 Scoring Architecture: Consensus Scoring, the 1–9 Total Score, and Percentiles

Scoring Architecture: Consensus Scoring, the 1–9 Total Score, and Percentiles

Quick Summary: PREview scoring evaluates behavioral judgment against a consensus key that AAMC develops in collaboration with medical school representatives. The scoring rule awards full credit for an exact match, half credit for a rating one step away on the same side of the effectiveness boundary, and zero credit for any rating on the opposite side. Raw scores are converted into a total score from 1 to 9, reported with a confidence band and a percentile rank.

---

1. The Foundation of Consensus Scoring in Situational Judgment Tests

Unlike traditional medical licensing examinations or MCAT science sections where questions have a single, indisputably factual answer (e.g., the molecular mechanism of an enzyme or the kinematics of a projectile), professional dilemmas rarely possess a single mechanical solution. Instead, ethical decision-making, interpersonal diplomacy, and patient advocacy depend on contextual judgment.

To establish a standardized rubric for complex human behavior, AAMC uses consensus scoring. Here is exactly what AAMC states, and nothing more:

• Who sets the key: AAMC "collaborates with medical school representatives to develop the scoring key for the PREview exam (i.e., the key effectiveness rating for each response)." Those representatives "include admissions officers, faculty, student affairs representatives, and others who work closely with medical students and understand the expectations and professional standards of medical students."
• How content is validated: "All PREview scenarios and questions have been reviewed and validated by a panel of medical school representatives who have expertise in supervising and evaluating medical students, and their consensus ratings established the scoring key."
• What the score means: "Higher scores mean that your ratings align more closely with medical educators' consensus ratings, whereas lower scores mean your ratings align less closely."

A note on sourcing. Third-party prep frequently describes elaborate item-development machinery for PREview — named consensus methodologies, disagreement thresholds, item-retirement rules. AAMC publishes none of that. What matters for your preparation is the part AAMC does publish: the key is the modal judgment of experienced medical educators about how effective each response is, so your job is to predict that judgment, not to construct the answer you personally prefer.

There is also no challenge or rescore process. AAMC will consider feedback you email to askpreview@aamc.org for use in developing future forms, but it will not rescore your exam or release your answers — only your score, percentile ranking, and confidence band.

---

2. The Four-Point Rating Scale and the Partial Credit Engine

For every response item, examinees must assign one of four categorical ratings:

1. Very Ineffective
2. Ineffective
3. Effective
4. Very Effective

The scale is divided by an Effectiveness Boundary (the Midline) separating negative behaviors (1 and 2) from positive behaviors (3 and 4).

               INEFFECTIVE SIDE          |          EFFECTIVE SIDE
       [ 1 ]                   [ 2 ]     |     [ 3 ]                   [ 4 ]
  Very Ineffective          Ineffective  |   Effective             Very Effective
                                         |
<========================================|=======================================>
                              EFFECTIVENESS BOUNDARY

The Three Credit Tiers

The scoring engine computes credit for each of the 186 items according to a strict three-tier mathematical matrix:

1. Full Credit (1.0 Point): The examinee's rating matches the expert consensus rating exactly.
2. Partial Credit (0.5 Points) — The Same-Side Rule: The examinee's rating is one step removed from the expert consensus rating, provided both ratings remain on the same side of the effectiveness boundary.
   • Example A: Consensus is Effective (3); examinee selects Very Effective (4) $\rightarrow$ 0.5 points.
   • Example B: Consensus is Very Effective (4); examinee selects Effective (3) $\rightarrow$ 0.5 points.
   • Example C: Consensus is Ineffective (2); examinee selects Very Ineffective (1) $\rightarrow$ 0.5 points.
   • Example D: Consensus is Very Ineffective (1); examinee selects Ineffective (2) $\rightarrow$ 0.5 points.
3. Zero Credit (0.0 Points) — Crossing the Boundary: The examinee selects a rating on the opposite side of the effectiveness boundary, regardless of numerical proximity.
   • Example E: Consensus is Effective (3); examinee selects Ineffective (2) $\rightarrow$ 0.0 points.
   • Example F: Consensus is Very Ineffective (1); examinee selects Very Effective (4) $\rightarrow$ 0.0 points.

[!IMPORTANT] The High-Yield Strategic Rule: Polarity is King! Notice that selecting Ineffective (2) when the key is Effective (3) yields 0.0 points, even though they are adjacent numbers on the 4-point scale. Crossing the boundary—treating a constructive action as detrimental or vice versa—destroys all credit. In contrast, mistaking nuance (rating Effective instead of Very Effective) still retains 50% credit. In your test-taking approach, always resolve whether an action is positive or negative first before calibrating intensity.

---

3. The 1–9 Total Score and Form Equating

Raw scores—calculated as the sum of full and partial credit across all 186 items—are not reported directly to medical schools. Because different testing windows utilize distinct exam forms containing unique permutations of scenarios, forms may vary slightly in psychometric difficulty.

To ensure absolute fairness, the AAMC applies psychometric form equating:

• Raw scores are converted through equating onto a standardized metric ranging from 1 (lowest) to 9 (highest).
• A 6 earned on a harder form represents the same standard of professional readiness as a 6 earned on an easier form; that is the entire purpose of equating.
• The figure AAMC prints on your score report is labeled the total score, and it is a whole number from 1 to 9 — there are no half points. You will also see the term scaled score in AAMC's description of its $20 Scored Practice Exam; the two refer to the same converted metric.

[!IMPORTANT] Do not memorize a score-to-percentile conversion table. AAMC publishes the official PREview percentile ranks itself and rebuilds the table each May from the most recent three testing years, so any percentile figure attached to a given total score is valid only for the window AAMC computed it from. Third-party tables that assign fixed percentile bands to scores of 1 through 9 are reconstructions, and they go stale. Look up your score in AAMC's current published percentile table rather than in any secondary source — including this one.

What the total score does communicate is consistent across years:

Because a school sees your total score, confidence band, and percentile rank together, the single most useful preparation goal is not "hit a number" but "stop crossing the boundary," since boundary errors are the only mistakes that score zero.

---

4. Percentile Ranks and Confidence Bands

Official AAMC PREview score reports provided to examinees and medical schools contain three distinct pieces of data:

1. Total Score (1–9): The primary headline metric, reported as a whole number.
2. Percentile Rank: AAMC defines your percentile rank as "the percentage of examinees who received the same or lower scores." The ranking table is rebuilt in May of each year using data from the most recent three testing years. Your total score never changes, but the percentile attached to it can move when the new table takes effect — so quote the percentile from the table current at the time you apply, not one you looked up a year earlier.
3. Confidence Band: Standardized assessments carry measurement error. PREview reports a confidence band of plus or minus 1 point around your total score (for example, 6-8 for a score of 7). AAMC describes confidence bands as marking the range in which your true score likely lies, and states that they are intended to discourage distinctions between examinees with similar scores.

---

5. Score Validity, Retention, and AMCAS Transmission

• Automated Delivery: PREview scores are transmitted automatically to AMCAS. When your official score report is released (~30 days post-window), it links directly to your AAMC ID and populates across all submitted medical school applications without requiring additional administrative action or per-school fees.
• What Your Report Shows: AAMC states that your score report "will include all exams you have taken and scored since 2020, regardless of when, how, and where your scores are reported." You cannot select a single best attempt to send — releasing your report releases the whole history.
• Retention: AAMC retains your PREview score report indefinitely and will upload your scores to AMCAS again if you reapply in a future year.
• Irreversibility: Once you release a score to an application service or school, you may not retract that decision. Scores cannot be voided after they have been released.
• Score Validity Window: AAMC does not publish an expiration date for PREview scores. Individual programs set their own look-back policies, so confirm currency requirements with each target school rather than assuming a standard window.
• Non-AMCAS Schools: For schools outside AMCAS, you release scores through the Testing Services Score Reporting System. Any new scores you earn within one calendar year of that request are released automatically; after a year, you must submit a new request.