13.2 Evidence-Based Medicine & Study Designs
Key Takeaways
- Randomized Controlled Trials (RCTs) minimize selection bias via randomization and observer bias via blinding; Intention-to-Treat (ITT) analysis preserves randomization by analyzing all subjects in their assigned groups.
- Cohort studies track exposure groups over time to assess disease incidence, whereas case-control studies select subjects based on disease status and retrospectively evaluate exposure.
- The hierarchy of evidence ranks systematic reviews and meta-analyses of RCTs at Level I (highest) and expert opinion/animal studies at Level VI (lowest).
- Absolute Risk Reduction (ARR) measures the arithmetic difference in risk between control and treatment groups; Number Needed to Treat (NNT) is the reciprocal of ARR, rounded up to the nearest integer.
- Number Needed to Harm (NNH) is the reciprocal of Absolute Risk Increase (ARI) for an adverse event, typically rounded down to the nearest integer for patient safety.
Evidence-Based Medicine & Study Designs
Evidence-Based Medicine (EBM) is the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients. It integrates clinical expertise, patient values, and the best available scientific research. To practice EBM effectively, a clinician must evaluate the validity of clinical studies and understand their designs.
Primary Study Designs in Clinical Research
Clinical studies are broadly divided into experimental (where the investigator assigns the exposure or intervention) and observational (where the investigator observes natural exposures and outcomes).
1. Randomized Controlled Trials (RCTs) - Experimental
The RCT is the gold standard for establishing causal relationships between interventions and outcomes. Its strength lies in its design features:
- Randomization: Allocating participants to treatment or control arms by chance. This distributes both known and unknown confounding variables equally between the groups, eliminating selection bias.
- Blinding (Masking): Prevents bias in treatment delivery or outcome assessment.
- Single-blind: Patient is unaware of their allocation.
- Double-blind: Patient and treating clinician/assessor are unaware.
- Triple-blind: Patient, clinician, and data analyst are unaware.
- Intention-to-Treat (ITT) Analysis: A fundamental principle where all participants are analyzed in the group to which they were originally randomized, regardless of whether they adhered to the protocol, received the treatment, or dropped out. ITT maintains the baseline comparability achieved by randomization and prevents attrition bias. It contrasts with per-protocol analysis, which only includes patients who fully completed the treatment, often leading to an overestimation of drug efficacy by ignoring those who stopped due to side effects or lack of efficacy.
2. Cohort Studies - Observational
Cohort studies follow a group of individuals defined by their exposure status (exposed vs. unexposed) forward in time to observe the development of the outcome. They can be prospective (following participants into the future) or retrospective (using historical medical records to reconstruct exposure and follow-up to the present).
- Strengths: Excellent for establishing temporal sequences (exposure precedes outcome); allows calculation of incidence and Relative Risk (RR); can study multiple outcomes of a single exposure.
- Weaknesses: Expensive and time-consuming; susceptible to attrition bias (loss to follow-up over time) and confounding.
3. Case-Control Studies - Observational
Case-control studies are retrospective, starting with the outcome. Researchers identify individuals with the disease (cases) and matching individuals without the disease (controls). They then look back in time (via interviews or records) to compare the frequency of prior exposures.
- Strengths: Highly efficient for studying rare diseases or diseases with long latency periods; relatively quick and inexpensive.
- Weaknesses: Extremely vulnerable to recall bias (diseased patients may remember past exposures more vividly than healthy controls) and selection bias (difficulty in selecting a representative control group). Measures the Odds Ratio (OR), not Relative Risk.
4. Cross-Sectional Studies - Observational
Often called a "prevalence study" or "snapshot," this design assesses exposure and outcome simultaneously in a population at a single point in time.
- Strengths: Quick, inexpensive, and useful for determining prevalence and generating hypotheses.
- Weaknesses: Cannot establish a temporal relationship (does the exposure precede the disease?), a limitation known as temporal ambiguity.
The Hierarchy of Evidence
In EBM, clinical evidence is ranked in a hierarchy based on the study design's susceptibility to bias. Decisions should be guided by the highest level of evidence available.
| Level of Evidence | Study Design | Key Characteristics |
|---|---|---|
| Level I | Systematic Reviews & Meta-analyses of RCTs | Combines data from multiple high-quality RCTs to increase statistical power |
| Level II | Randomized Controlled Trials (RCTs) | Individual high-quality trials with low risk of bias |
| Level III | Cohort Studies | Observational; tracks exposed vs. unexposed over time |
| Level IV | Case-Control Studies | Observational; compares diseased cases with healthy controls |
| Level V | Cross-Sectional Studies & Case Series | Observational; population snapshots or reports on groups of patients |
| Level VI | Case Reports & Expert Opinion | Individual clinical narratives or consensus statements; lowest quality |
Core Calculations: NNT and NNH
To apply study results to clinical practice, physicians must translate relative risk reductions into absolute measures that reflect the real-world impact on patients.
Number Needed to Treat (NNT)
NNT is the number of patients that must be treated with a specific intervention to prevent one additional adverse outcome. It is the reciprocal of the Absolute Risk Reduction (ARR).
- Calculate risk in the control group ($R_{\text{control}}$) and treatment group ($R_{\text{treatment}}$).
- Calculate ARR:
- Calculate NNT:
Clinical Rule: NNT must always be rounded UP to the nearest whole integer (e.g., $12.1 \rightarrow 13$), because you cannot treat a fraction of a patient, and rounding down would overestimate the benefit of the treatment.
Example: In a clinical trial for a new drug to prevent cardiovascular events, the incidence of myocardial infarction is 8% in the control group and 5% in the treatment group.
- $\text{ARR} = 0.08 - 0.05 = 0.03$ (or 3%)
- $\text{NNT} = 1 / 0.03 = 33.33 \rightarrow \mathbf{34}$. You need to treat 34 patients to prevent one myocardial infarction.
Number Needed to Harm (NNH)
NNH is the number of patients treated with an intervention before one patient experiences an adverse drug event or side effect. It is the reciprocal of the Absolute Risk Increase (ARI) or Attributable Risk.
- Calculate ARI:
- Calculate NNH:
Clinical Rule: For patient safety, NNH is typically rounded DOWN to the nearest whole integer (e.g., $22.7 \rightarrow 22$) to avoid underestimating the potential for harm.
Example: In the same trial, 4% of patients in the treatment group experienced severe gastritis compared to 1% in the control group.
- $\text{ARI} = 0.04 - 0.01 = 0.03$
- $\text{NNH} = 1 / 0.03 = 33.33 \rightarrow \mathbf{33}$. For every 33 patients treated, one will develop severe gastritis.
In a randomized clinical trial of a new antiplatelet drug to prevent stroke in high-risk patients, 1,000 patients received the new drug and 1,000 patients received aspirin. Over a 5-year follow-up, 40 patients in the new drug group had a stroke compared to 90 patients in the aspirin group. What is the Number Needed to Treat (NNT) to prevent one stroke over 5 years?
A group of researchers wants to investigate the association between maternal exposure to a specific pesticide during pregnancy and the development of a rare congenital heart defect in offspring. Because the heart defect is extremely rare, they identify 150 infants diagnosed with the defect and 300 healthy infants of similar gestational age. They interview the mothers about pesticide exposure during pregnancy. What type of study design is this?
In a randomized controlled trial comparing a new coronary stent to medical therapy, 50 patients randomized to the stent group experienced severe panic and refused the procedure, opting for medical therapy instead. In the final analysis, the researchers analyze these 50 patients as part of the stent group. What is this analytical approach, and what is its primary benefit?