9.2 Critical Appraisal and Evidence Fit

Appraising evidence for the client in front of you

Part 2 does not usually ask candidates to calculate statistics in isolation. It asks whether a psychologist can use research responsibly when the facts are messy. Critical appraisal means evaluating the quality, relevance, and limits of evidence before applying it. The exam may show a treatment with strong support, a client with complicating features, and several plausible next steps. The best answer usually keeps the evidence base in view while responding to the specific clinical problem.

The first question is methodological: how much confidence should the evidence receive? Stronger support often comes from well-controlled studies, replicated findings, clinically meaningful outcomes, valid measurement, and samples that resemble the target population. Weaker support may come from testimonials, uncontrolled impressions, very small samples, or studies that do not measure the outcome being promised. Part 2 may not name these designs directly, but it expects the same reasoning.

A common Part 2 pattern is an evidence-based treatment that is almost, but not quite, ready to use. For example, a manualized intervention may be appropriate for panic symptoms, but the stem may show active psychosis, cognitive limitations, language mismatch, or immediate self-harm risk. The strongest answer would not reject science; it would sequence care. The psychologist might stabilize risk, obtain consultation, adapt materials, include interpreters when appropriate, or choose a validated alternative.

Another pattern is overclaiming from assessment data. A screening score may indicate the need for further evaluation, but it does not always establish a diagnosis. A test norm may be valid for one population and questionable for another. A statistically noticeable change may not be meaningful in daily functioning. Critical appraisal protects the client from decisions that look technical but rest on weak fit.

Use this evidence-fit checklist while studying vignettes:

• Identify the claim being made about an assessment or intervention.
• Ask whether the method measures or changes the actual target problem.
• Check whether the client resembles the population for which the method has support.
• Look for risk factors that change timing or require a higher level of care.
• Consider whether adaptation would preserve the purpose of the method.
• Document uncertainty and seek consultation when fit is unclear.

Evidence fit is not a reason to abandon structure. A clinician should not replace a supported trauma intervention with an untested favorite simply because a client is complex. The better move is to use the evidence base as a framework, then adjust language, pacing, examples, measurement, coordination, and safety planning. If the necessary adaptation would change the active elements so much that the method no longer fits, the psychologist should consider a different evidence-supported option or consult.

Client preference has a place, but it does not override competence, safety, or validity. A client may prefer no assessment, a family may request an unsupported technique, or an agency may pressure for a quick conclusion. The scientifically oriented response respects preferences through explanation and shared decision making while maintaining professional standards. The psychologist can offer choices among appropriate options, explain risks and benefits, and document the rationale.

For Part 2, the key is to read for constraints. The exam rarely rewards the answer that sounds most enthusiastic about research or the answer that dismisses research as too narrow. It rewards disciplined application: what evidence says, where it fits, where it does not fit, and what responsible step follows.