1.5 Ecological, Performance-Based & Technology-Supported Assessment

Why These Methods Are on the Test

The ETS outline lists three assessment skills that go beyond standardized tests: performance-based assessment (work samples, portfolios), ecological assessment (classroom, family, and community characteristics), and using information and technology resources to enhance data collection and decision making. Each answers a question that norm-referenced tests cannot: What is happening in this student's actual environment, and what can we change?

Ecological Assessment

Ecological assessment treats a learning or behavior problem as a mismatch between the student and the environment rather than a deficit inside the student. It follows Bronfenbrenner's model, which nests the child within the microsystem (classroom, family, peers), mesosystem (connections among them, such as home–school communication), exosystem (settings that affect the child indirectly, such as a parent's workplace or district policy), and macrosystem (cultural values, economic conditions).

What an Ecological Assessment Examines

Structured tools exist for the classroom level. Ecobehavioral assessment records how student behavior co-occurs with instructional arrangements moment by moment (for example, the code-based systems developed at the Juniper Gardens Children's Project). Instructional-environment rating systems such as the Functional Assessment of Academic Behavior (FAAB), the successor to Ysseldyke and Christenson's Instructional Environment System, rate the quality of instruction and home support for learning.

The core principle matches the ICEL framework in Section 1.1: examine instruction, curriculum, and environment before concluding the problem lies in the learner. These are the variables a team can change.

Curriculum-Based Assessment for Instructional Design (CBA-ID)

Curriculum-based assessment (CBA) is a broad term for assessing students with materials from their own curriculum. CBM (Section 1.2) is one standardized form used to monitor growth. CBA for instructional design (CBA-ID), associated with Gickling, is used to decide what to teach and at what difficulty:

• The examiner samples the student's actual reading material and counts known versus unknown words.
• A task is at the instructional level when about 93–97% of the words are known for reading, or about 70–85% of items are known for drill-and-practice activities.
• Material below the instructional level produces frustration (too many unknowns, which often triggers escape behavior); material above it is independent level.
• The teacher then adjusts material or pre-teaches unknowns to create an instructional match.

This approach links directly to intervention. When a student's off-task behavior happens only during frustration-level reading, CBA-ID results point to changing the material, not the student.

Performance-Based and Authentic Assessment

Performance-based assessment asks students to produce work or demonstrate skills in realistic tasks rather than select answers.

Making Performance Assessment Defensible

Performance assessments have strong instructional validity, but their reliability depends on scoring. Good practice includes:

• Rubrics: analytic rubrics score separate traits (organization, conventions, ideas); holistic rubrics give one overall score.
• Anchor papers that illustrate each score point.
• Inter-rater agreement checks, with two raters scoring a sample of work.
• Documentation of the conditions under which the work was produced.

Performance data complement, and do not replace, standardized measures. Because IDEA requires a variety of assessment tools and prohibits relying on a single measure, work samples and portfolios are valuable parts of a comprehensive evaluation.

Technology Resources for Data Collection and Decision Making

Technology now touches almost every assessment task:

• Data systems store screening, progress-monitoring, attendance, and discipline data (for example, SWIS for office discipline referrals) and graph trends for team meetings.
• Early warning systems flag students using attendance, behavior, and course-performance indicators (often called the "ABCs") to predict dropout risk.
• Digital administration and scoring platforms present items on tablets and calculate scores automatically.
• Computer-adaptive tests adjust item difficulty to the student's responses, which shortens testing.
• Remote (telehealth) assessment allows evaluation at a distance when appropriate.

Ethical Guardrails

• Validity of the digital format: NASP Standard II.3.5 requires school psychologists to choose digital administration, scoring, and interpretation programs that meet professional standards for accuracy and validity, and to use professional judgment in evaluating digitally assisted findings. Automated interpretive reports do not replace the psychologist's interpretation.
• Remote administration: Before using a test remotely, check whether the publisher provides evidence that remote scores are comparable to in-person norms. Document any change to standard procedures, as Standard II.3.3 requires.
• Security and privacy: Standard II.4.7 requires protecting electronic files from unauthorized release or modification (passwords, encryption) and preventing loss from equipment failure. Parents are notified about electronic storage and transmission of records and the associated risks (Standard II.4.1).
• Data use: Dashboards support decisions; they do not make them. A flag from an early warning system starts a problem-solving conversation, not a placement.

Exam Scenario Pattern

When an item describes a student who struggles only in one class, with one type of task, or at one time of day, look for an ecological answer (check instructional match, classroom routines, or environment) rather than a within-child explanation.