4.2 Types of Evidence: Internal vs. External Evidence

Types of Evidence: Internal vs. External Evidence

A foundational concept in EBD practice is the dual-evidence framework. Evidence-Based Design does not rely solely on academic research published in medical journals, nor does it rely solely on a hospital's internal operating statistics. Rather, exemplary EBD practice requires the deliberate, systematic synthesis of two distinct streams of data: external evidence and internal evidence.

Understanding the distinct characteristics, data sources, strengths, and limitations of each evidence class is essential for navigating the predesign, programming, and post-occupancy evaluation phases of any healthcare project.

---

The Dual-Evidence Framework: Complementary Roles

To visualize how external and internal evidence interact, consider their primary functions in the EBD methodology:

• Internal Evidence Answers: "What is happening in our specific organization? Where are our greatest clinical vulnerabilities, operational bottlenecks, staff injuries, and financial losses? What are our baseline performance numbers?"
• External Evidence Answers: "What generalizable principles, environmental interventions, and design strategies have been studied for these problems in other healthcare facilities, and how strong is that evidence? What effect sizes can we reasonably expect?"

┌──────────────────────────────────────┐       ┌──────────────────────────────────────┐
│          INTERNAL EVIDENCE           │       │          EXTERNAL EVIDENCE           │
│     (Organization-Specific Data)     │       │     (Peer-Reviewed Literature)       │
└──────────────────┬───────────────────┘       └──────────────────┬───────────────────┘
                   │                                              │
                   │ Diagnoses Local Problems                     │ Provides Proven Design
                   │ & Establishes Baselines                      │ Concepts & Causal Links
                   │                                              │
                   └───────────────────────┬──────────────────────┘
                                           │
                                           ▼
                       ┌───────────────────────────────────────┐
                       │       EBD DESIGN HYPOTHESIS &         │
                       │         CAPITAL INTERVENTION          │
                       └───────────────────────────────────────┘

---

External Evidence: Rigorous, Generalizable Science

External evidence consists of empirical research findings generated by independent investigators and published in peer-reviewed academic journals, systematic literature reviews, government health research monographs, and validated institutional repositories. Its defining attribute is generalizability—the degree to which findings can be applied across different settings, patient populations, and facility types.

Primary Sources of External Evidence

1. Peer-Reviewed Academic & Professional Journals:

   • Health Environments Research & Design Journal (HERD): An interdisciplinary, peer-reviewed journal dedicated to research on healthcare environments, launched in 2007 and published by SAGE. HERD features empirical studies of how physical design relates to patient, staff, and organizational outcomes.
   • Environment and Behavior (E&B): A leading multidisciplinary journal examining the relationship between physical environments and human psychological, cognitive, and social behaviors.
   • Clinical, Medical, and Nursing Journals: High-impact biomedical publications such as The New England Journal of Medicine (NEJM), The Lancet, The American Journal of Infection Control (AJIC), BMJ Quality & Safety, and the Journal of Advanced Nursing, which frequently publish landmark studies on nosocomial infection transmission, nurse fatigue, and clinical errors.
   • Building Science & Architectural Engineering Journals: Publications including Applied Ergonomics, Building and Environment, Lighting Research & Technology, and the Journal of the Acoustical Society of America.

2. Curated Research Repositories & Knowledge Centers:

   • The Center for Health Design (CHD) Knowledge Repository: A searchable collection of healthcare design research that includes key point summaries for many studies.
   • Research Design Connections: A specialized information service translating behavioral science and environmental psychology research into practical architectural applications.
   • AIA Academy of Architecture for Health (AAH) Resources: Case study repositories, research grant reports, and healthcare design monographs.

3. Clinical Practice Guidelines & Federal Scientific Agencies:

   • Centers for Disease Control and Prevention (CDC): Guidelines for Environmental Infection Control in Healthcare Facilities, detailing airborne transmission, waterborne pathogen mitigation, and surface disinfection criteria.
   • Agency for Healthcare Research and Quality (AHRQ): Evidence reports on patient safety, physical environment design, and clinical decision support.
   • National Institute for Occupational Safety and Health (NIOSH): Research on healthcare ergonomics, safe patient handling, and acoustic thresholds for healthcare workers.
   • Facility Guidelines Institute (FGI): Guidelines for Design and Construction of Hospitals, Outpatient Facilities, and Residential Health, Care, and Support Facilities.

Strengths and Limitations of External Evidence

• Strengths: Often uses more rigorous designs; peer-reviewed vetting; findings from multiple settings; the strongest designs can support causal conclusions rather than simple associations.
• Limitations: May reflect ideal or highly controlled research environments; often published 2 to 5 years after data collection; may not account for unique operational models, union staffing constraints, or regional patient demographics of a specific facility.

---

Internal Evidence: Context-Specific Organizational Intelligence

Internal evidence encompasses the proprietary clinical, operational, experiential, financial, and physical facility data collected systematically within the healthcare organization itself. It reflects the organization's unique reality, culture, processes, and historical performance.

Core Categories and Specific Sources of Internal Evidence

1. Clinical Quality & Patient Safety Incident Data

• Hospital-Acquired Infections (HAIs): Surveillance data collected by the hospital's Infection Prevention team tracking rates of Central Line-Associated Bloodstream Infections (CLABSI), Catheter-Associated Urinary Tract Infections (CAUTI), Surgical Site Infections (SSI), and contact-transmitted pathogens (C. difficile, MRSA, VRE). High localized infection rates often highlight inadequate hand-hygiene sink locations, shared toilet facilities in multi-bed units, or poor HVAC pressure differentials.
• Patient Falls and Fall-with-Injury Rates: Incident reports logged in internal safety systems and submitted to national benchmarks like the National Database of Nursing Quality Indicators (NDNQI). Data includes total falls per 1,000 patient days, falls during unassisted bathroom transfers, and nighttime falls occurring during medication-induced disorientation.
• Medication Administration Errors (MAEs): Voluntary safety reporting logs, electronic health record (EHR) error-interception alerts, and smart-infusion-pump data logs. Tracks dosing errors, transcription slips, wrong-patient administrations, and interruptions during the medication preparation cycle.

2. Patient & Family Experiential Metrics

• HCAHPS (Hospital Consumer Assessment of Healthcare Providers and Systems): The standardized, publicly reported survey required by the Centers for Medicare & Medicaid Services (CMS). Relevant environmental dimensions include:
  • "Quietness of hospital environment at night"
  • "Cleanliness of hospital environment"
  • "Responsiveness of hospital staff"
• Press Ganey Surveys & Qualitative Patient Feedback: Inpatient, outpatient, and emergency department satisfaction surveys, patient advisory council transcripts, and patient grievance logs.

3. Staff Ergonomics, Occupational Safety & Culture

• OSHA 300 Logs & Workers' Compensation Reports: Legally mandated logs tracking work-related injuries and illnesses among healthcare staff. Highlights musculoskeletal injuries from manual patient repositioning, slip-and-fall injuries on wet dietary or surgical floors, and sharps punctures.
• Staff Engagement and Safety Culture Surveys: Validated instruments such as the AHRQ Hospital Survey on Patient Safety Culture and the Maslach Burnout Inventory (MBI), revealing clinician fatigue, moral distress, and turnover intention.

4. Spatial, Operational & Facility Performance Data

• Spatial Utilization and Workflow Tracking: Data derived from Real-Time Locating Systems (RTLS) tracking nurse footsteps, staff transit distances, supply room visits, patient transport times, and equipment search delays.
• Bed Turnover & Throughput Metrics: Emergency department dwell times, Left-Without-Being-Seen (LWBS) percentages, post-anesthesia care unit (PACU) boarding hours, and environmental services (EVS) bed-turnaround times.
• Prior Post-Occupancy Evaluations (POEs): Findings, facility maintenance logs, and physical audits from previous construction phases or renovation projects within the health system.

Strengths and Limitations of Internal Evidence

• Strengths: Directly reflects the specific patient population, clinical care delivery model, and organizational culture; provides immediate baseline metrics against which project ROI can be evaluated.
• Limitations: Susceptible to internal reporting biases (e.g., under-reporting of medication near-misses); may lack rigorous statistical controls for confounding variables; cannot be assumed generalizable to other healthcare institutions.

---

Comparison: Internal vs. External Evidence

The following matrix summarizes the essential distinctions:

---

Experiential Knowledge: Expert and User

EDAC study materials also recognize experiential knowledge as an input alongside research and data:

• Expert experiential knowledge is provided by members of the project team and various consultants (for example, clinicians, planners, engineers, and researchers drawing on professional experience).
• User experiential knowledge is provided by users and their families (for example, patients describing what made a stay stressful).

Experiential knowledge helps frame questions and interpret evidence, but it is not a substitute for credible research or measured internal data.

---

Hypothetical Case Study: How Internal and External Evidence Converge

To see how an evidence-based design team synthesizes internal and external evidence in practice, consider a hypothetical 350-bed community hospital planning the replacement of its 32-bed inpatient oncology unit.

STEP 1: INTERNAL EVIDENCE (The Diagnostic Trigger)
  • Hospital OSHA 300 logs reveal 14 registered nurse musculoskeletal strain injuries
    over 18 months, resulting in $380,000 in workers' compensation and overtime costs.
  • NDNQI incident reports document 4.8 falls per 1,000 patient days on the oncology unit,
    with 68% of falls occurring unassisted between 23:00 and 05:00 en route to the toilet.
  • HCAHPS scores for "Quietness at Night" sit in the 18th national percentile.
  ──>
STEP 2: EXTERNAL EVIDENCE (The Architectural Prescription)
  • Published safe-patient-handling studies report fewer staff handling injuries when
    ceiling lifts are installed AND consistently used.
  • Research on bed-to-toilet paths suggests short, supported, visible paths may reduce
    fall risk, although study results are mixed and context-dependent.
  • Acoustic studies show that higher sound absorption shortens reverberation and can
    lower sound levels and improve speech intelligibility.
  ──>
STEP 3: THE SYNTHESIZED EBD DESIGN HYPOTHESIS
  • "Implementing continuous ceiling-mounted patient lifts extending from the bed into the
    bathroom, combined with a direct-line same-handed bathroom layout and NRC 0.90 acoustic
    ceiling finishes, will reduce staff lifting injuries by at least 50%, reduce unassisted
    falls by 35%, and elevate HCAHPS quietness scores to above the 60th percentile within 12
    months of occupancy."

By uniting internal evidence (the baseline diagnosis) with external evidence (the best available research on interventions), the design team creates an accountable, verifiable capital project.

[!TIP]

EXAM TIP: Identifying Evidence Sources

When a scenario describes a design team reviewing OSHA 300 logs, NDNQI fall statistics, or HCAHPS satisfaction survey results, immediately classify this as Internal Evidence.

When the question references published meta-analyses, articles in HERD, or CDC infection guidelines, classify this as External Evidence.