10.1 ETS Constructed-Response Scoring Rubrics and Analytical Framework

10.1 ETS Constructed-Response Scoring Rubrics and Analytical Framework

SLLA Core Leadership Principle: Rigorous Analytical Communication (PSEL Standard 9 & 10) School leaders must be able to rapidly synthesize complex qualitative and quantitative data, identify root pedagogical and organizational issues, formulate actionable and legally sound interventions, and establish accountable monitoring frameworks. On the School Leaders Licensure Assessment (SLLA 6990), Section II tests this capacity directly through four constructed-response prompts. Success requires not merely general educational knowledge, but a disciplined, structured analytical writing approach that strictly adheres to the ETS scoring rubric.

---

1. Architecture of Section II of the SLLA 6990

The SLLA 6990 examination is divided into two distinct testing sections that evaluate prospective educational leaders on both broad administrative knowledge and applied clinical reasoning:

• Section I: Multiple-Choice Questions (MCQs)
  • 120 selected-response items administered over 165 minutes (2 hours 45 minutes).
  • Accounts for 75% of the total scaled score.
• Section II: Constructed-Response Questions (CRQs)
  • 4 written constructed-response questions administered over 75 minutes (1 hour 15 minutes).
  • Accounts for 25% of the total scaled score.
  • Pacing budget: Approximately 18 to 19 minutes per prompt.

SLLA 6990 TOTAL SCORE WEIGHTING:
┌─────────────────────────────────────────────────────────────┬───────────────────────────┐
│ Section I: 120 Multiple-Choice Questions (75%)              │ Section II: 4 CRQs (25%)  │
│ Time: 165 Minutes (~82 seconds / question)                  │ Time: 75 Minutes (~18 min)│
└─────────────────────────────────────────────────────────────┴───────────────────────────┘

Digital Interface and Navigation

The examination is administered via a computer-based testing interface featuring a split-screen layout. The left pane provides stimulus documents—such as classroom observation field notes, teacher lesson plans, school performance data tables, parent survey results, or district policy memos. The right pane provides the specific prompt sub-questions and an open word-processing text box. Candidates can navigate freely among the four constructed-response questions during the 75-minute window.

Official Scoring Information

The official study companion states that each constructed response receives a score from 0 to 3. Responses are evaluated on the completeness, accuracy, and depth of the candidate's demonstrated understanding. Candidates should support answers with appropriate reasons and examples. Writing ability is not scored independently, although an unclear response can prevent a scorer from recognizing the candidate's knowledge. The public companion does not support claims here about a fixed two-rater adjudication workflow, scorer occupations, or a particular raw-score-combination formula.

---

2. Interpreting the Official 0–3 Scale

These descriptions are study paraphrases of the companion's general factors, not a claim that ETS separately awards fixed points for diagnosis, action, justification, or monitoring.

The Critical Distinctions Between Score 2 and Score 3

Many test-takers obtain Score 2 because their answers are reasonable but generic. The hallmark of a Score 3 response is granular specificity: instead of writing "the principal will provide professional development on reading," a Score 3 candidate writes, "the principal will partner with the instructional coach to deliver job-embedded professional development on the Sheltered Instruction Observation Protocol (SIOP), focusing specifically on Tier 2 academic vocabulary acquisition and sentence frames for English Learners, supported by biweekly coaching walkthroughs."

---

3. A Study Framework: D-A-J-M

D-A-J-M is a preparation aid, not the ETS scoring rubric. Use Diagnose, Action, Justify, and Monitor when those moves fit the prompt; do not add a monitoring plan or legal citation when the question asks for something else. Always answer each explicit task first:

┌─────────────────────────────────────────────────────────────────────────────┐
│                     THE 4-STEP ANALYTICAL RESPONSE FRAMEWORK                 │
├─────────────────────────────────────────────────────────────────────────────┤
│  1. IDENTIFY & DIAGNOSE (D)                                                 │
│     • Pinpoint the primary instructional or systemic root problem.          │
│     • Cite specific relevant qualitative or quantitative evidence.           │
│                                                                             │
│  2. FORMULATE SPECIFIC ACTIONS (A)                                          │
│     • Outline 2-3 sequential, high-leverage administrative steps.           │
│     • Define precisely WHO is responsible, WHAT they do, and WHEN.          │
│                                                                             │
│  3. PROVIDE EDUCATIONAL & LEGAL JUSTIFICATION (J)                           │
│     • Explain WHY this action is superior to alternative interventions.     │
│     • Ground rationale in PSEL standards, research-based pedagogy, or law.   │
│                                                                             │
│  4. PROGRESS MONITORING & EVALUATION (M)                                    │
│     • Identify leading indicators (formative checks, classroom walkthroughs)│
│     • Identify lagging indicators (benchmark tests, state accountability).  │
│     • Establish concrete review cycles (bi-weekly, quarterly).              │
└─────────────────────────────────────────────────────────────────────────────┘

Step 1: Identify & Diagnose (With Direct Evidence)

Begin by directly naming the underlying pedagogical, organizational, or cultural failure. Avoid merely restating the prompt symptom; identify the underlying root cause. Immediately support the diagnosis with verbatim phrases, specific line numbers, or exact numerical values extracted from the stimulus tables or observation notes.

Step 2: Formulate Specific Actions (Feasible and High-Leverage)

Articulate concrete administrative moves. High-scoring responses assign clear roles (e.g., principal, instructional coach, department chair, PLC team) and realistic implementation horizons (e.g., immediate 48-hour debrief, 6-week coaching cycle, semester benchmark review). Actions must emphasize shared leadership and instructional capacity building rather than punitive evaluation.

Step 3: Provide Educational and Legal Justification (PSEL Alignment)

Explicitly articulate why the proposed interventions are sound. Connect actions to established educational leadership frameworks: PSEL Standard 4 (Curriculum, Instruction, and Assessment), PSEL Standard 6 (Professional Capacity of School Personnel), or PSEL Standard 10 (School Improvement). Demonstrate awareness of collective bargaining agreements, due process, special education regulations (IDEA), and civil rights protections.

Step 4: Progress Monitoring and Evaluation (Leading and Lagging Indicators)

When the prompt calls for implementation or evaluation, close with an accountable monitoring approach. Useful distinctions include:

• Leading Indicators (Formative/Process): Bi-weekly PLC common formative assessment data, 15-minute administrative walkthrough rubrics, coaching feedback logs, lesson plan audits.
• Lagging Indicators (Summative/Outcome): Quarterly benchmark exam scores, end-of-course state assessments, chronic absenteeism rates, disaggregated subgroup graduation rates.

---

4. Time Management and Formatting Strategy

With only 75 minutes allocated for 4 multi-part questions, time management is the single greatest operational hazard on Section II of the SLLA.

The 18-Minute Pacing Protocol per Question

MINUTES 00:00 - 03:00 (3 Minutes): ACTIVE READING & EVIDENCE ANNOTATION
• Read the prompt sub-questions first to establish targeted reading purpose.
• Read the stimulus document actively, noting key data anomalies or teacher behaviors.
• Jot down 2-3 pieces of direct evidence for immediate citation.
──────────────────────────────────────────────────────────────────────────
MINUTES 03:00 - 15:00 (12 Minutes): TARGETED DRAFTING
• Use the 4-Step Analytical Template (D-A-J-M).
• Create clear section headings matching the prompt letters (e.g., "[Part A: Diagnosis]").
• Draft clear, complete sentences organized in structured bullet points.
──────────────────────────────────────────────────────────────────────────
MINUTES 15:00 - 18:00 (3 Minutes): SCORER SELF-AUDIT & VERIFICATION
• Verify that every prompt sub-bullet has been directly answered.
• Check that specific evidence from the stimulus is explicitly cited.
• Include progress monitoring when the prompt or proposed implementation calls for it.

Structured Formatting vs. The "Essay Trap"

A pervasive error among candidates is treating the constructed-response section as a traditional academic essay. Writing lengthy introductory paragraphs, rhetorical transitions, and grand philosophical conclusions consumes precious time without earning rubric credit. ETS evaluates the substance described in the official scoring factors, not a required checklist layout. Candidates may use brief subheadings or evidence-rich bullets when they make a multipart response clearer:

• Ineffective (Unstructured Essay): "Throughout the history of American education, science instruction has always been a vital component of middle school curriculum. In reviewing the lesson conducted by Mr. Vance, one can see that many different challenges exist in modern classrooms. In my opinion as a future principal, I believe that teachers must always strive to inspire their students to love learning..."
• Effective (Structured Analytical Writing):
  • Part A: Instructional Weaknesses and Evidence
    • Weakness 1: Ineffective Instructional Pacing and Excessive Non-Instructional Dead Time. During the 55-minute period, 14 minutes were consumed at the start by administrative tasks while students were unengaged, and 7 minutes were lost at the end, meaning 38% of instructional time was completely lost.
    • Weakness 2: Lack of Formative Assessment and Differentiated Scaffolding. The teacher delivered an 18-minute verbatim slide lecture without checking for understanding and assigned a DOK 1 worksheet without scaffolding for the 5 English Learners present.

---

5. Three Fatal Exam Traps on SLLA Constructed-Response Items

Trap 1: The Punitive Administrator Trap

When faced with a struggling teacher or declining test scores, weak candidates default to punitive, authoritarian measures—such as placing the teacher on an immediate formal remediation plan, giving an unsatisfactory evaluation, or threatening reassignment. On the SLLA, effective instructional leadership is collaborative, supportive, and capacity-building. Formal disciplinary or remediation actions are reserved strictly for gross misconduct, ethical violations, or documented failure to improve after comprehensive coaching support.

Trap 2: The Deficit Mindset Trap

When analyzing disaggregated data showing underperforming subgroups (e.g., English Learners or Students with Disabilities), weak responses attribute the failure to student deficits, lack of parental involvement, or socio-economic background. ETS scorers immediately penalize deficit-oriented explanations. High-scoring leaders examine systemic adult practices: curricular alignment, quality of Tier 1 core instruction, teacher professional development, and resource allocation.

Trap 3: The Administrative Vagueness Trap

Recommending that a teacher "improve classroom management" or that the school "buy new software" without operational details earns a Score 1. High-scoring responses specify the exact pedagogical tool, instructional protocol, coaching model, and collaborative team responsible for execution.