6.2 Gathering Objective Evidence: Interviewing, Observation & Sampling

6.2 Gathering Objective Evidence: Interviewing, Observation & Sampling

Quick Answer: Under ISO 19011:2018 Clause 6.4.7, audit evidence must be collected, verified, and evaluated against audit criteria to produce audit findings. The bedrock of reliable evidence gathering is Triangulation—the cross-verification of three primary sources: (1) Interviews (verbal testimony), (2) Observation (physical site conditions and operations), and (3) Documented Information (records, logs, calibrations, permits). A verbal statement alone is an unsubstantiated assertion; it only becomes valid objective evidence when corroborated by observable conditions or documented records.

---

The Doctrine of Evidence Triangulation

Objective evidence is defined in ISO 19011:2018 (Clause 3.8) as "data supporting the existence or verity of something." In environmental auditing, drawing conclusions from a single source of information introduces severe risk of bias, misinformation, or superficiality.

                         TRIANGULATION OF AUDIT EVIDENCE
                         
                                INTERVIEWS
                            (Verbal Statements,
                             Operator Knowledge)
                                    /   \
                                   /     \
                                  /       \
                                 /         \
                     PHYSICAL                   DOCUMENTED
                   OBSERVATION                 INFORMATION
               (Workplace practices,       (Calibration logs, waste
                bunds, emissions)           manifests, test data)

The Failure of Single-Source Evidence

• The Verbal Trap: Relying solely on interviews exposes the auditor to optimistic assertions, rehearsed narratives, or honest worker misconceptions. A manager stating, "We always test our stormwater shutoff valve weekly," provides zero objective evidence that the valve works or that testing occurs.
• The Pristine Document Trap: Relying solely on records exposes the auditor to paper-based compliance. A company may display immaculate daily inspection checklists that are signed in advance ("dry-labbing") while the physical oil interceptor is overflowing on site.
• The Sanitized Snapshot Trap: Relying solely on brief visual observation without reviewing historical trends or interviewing personnel may lead to misjudging an abnormal temporary situation as standard operating procedure.

The Triangulation Rule: To establish a defensible finding, the auditor must cross-check. For example, when auditing solvent degassing:

1. Interview: Ask the operator how solvent bath temperatures are controlled and how vapors are recovered.
2. Observation: Inspect the physical vapor recovery hood, observe whether condenser coils are free of frost, and check for fugitive solvent odors.
3. Documented Information: Review solvent purchase logs, volatile organic compound (VOC) monitoring records, and maintenance logs for the chiller units.

---

Professional Interviewing Techniques for Lead Auditors

Auditing is fundamentally an interpersonal communication exercise. The auditor must elicit candid, technically accurate information while putting auditees at ease.

The Funnel Questioning Technique

The most effective questioning methodology is the Funnel Technique, which moves systematically from broad exploratory questions down to specific verifications:

  +-------------------------------------------------------------+
  | 1. OPEN QUESTIONS: Broad exploration                        |
  |    "Can you describe your daily chemical handling routine?" |
  +-------------------------------------------------------------+
         \                                               /
          \  2. PROBING QUESTIONS: Detailed investigation /
           \    "What happens if this holding tank fills?"/
            +-------------------------------------------+
                   \                             /
                    \ 3. CLOSED QUESTIONS: Check /
                     \  "Is this valve locked?" /
                      +-----------------------+

1. Open-Ended Questions (The 6 Honest Serving Men): Begin inquiries using What, Where, When, How, Why, and Who (or "Show me..." and "Explain to me..."). Open questions encourage the auditee to speak freely and explain operational context without feeling interrogated.
2. Probing / Clarifying Questions: Drill down into operational specifics: "You mentioned that sludge is pumped twice a shift—what parameters signal that pumping is needed?" or "Can you walk me through the step-by-step procedure when the alarm sounds?"
3. Closed Questions: Use sparingly to confirm specific, binary facts: "Does this flowmeter possess an in-date calibration sticker?" or "Are you the designated hazardous waste emergency coordinator?"

Communication Traps to Avoid

• Avoid Leading Questions: Never ask, "You inspect this bund every morning, don't you?" The auditee will reflexively agree. Instead, ask: "How frequently is this bund inspected, and how do you record the results?"
• Avoid Multiple / Compound Questions: Asking three questions at once ("Where is the waste stored, who takes it away, and do you check their permit?") confuses the auditee, who will typically answer only the easiest part.
• Avoid Accusatory Phrasing: Do not ask, "Why did you fail to sign this logbook?" Instead, ask: "Can you explain the procedure for signing off this logbook upon task completion?"

---

Handling Difficult Auditee Personalities

Lead auditors encounter diverse psychological dynamics during on-site evaluations. Professionalism requires emotional composure and disciplined techniques.

---

Conducting the Site Tour & Physical Workplace Investigation

The physical site walk is where environmental audits are won or lost. Lead auditors do not merely stroll along painted pedestrian walkways; they follow the physical flow of materials and energy from receipt to discharge.

                               SYSTEMATIC SITE TOUR TRAIL
                               
   [ Raw Material ]       [ Production /  ]       [ Waste Generation ]       [ Outfalls /   ]
   [ Receiving    ] ----> [ Transformation] ----> [ & Storage        ] ----> [ Interceptors ]
          |                      |                         |                        |
          v                      v                         v                        v
   Check: Bulk tanks,     Check: Fume hoods,      Check: Bund volume,       Check: Penstock
   spill kits, intake     scrubbers, leaks,       drum labeling,            valves, CEMS,
   drains, MSDS sheets    cooling towers, noise   segregation, sump pumps   sampling ports

Critical Environmental Inspection Points

1. Material Receiving and Bulk Unloading Bays:
   • Are storm drains adjacent to tanker offloading points fitted with shut-off valves or emergency pneumatic bungs?
   • Are chemical delivery transfer hoses equipped with dry-break couplings?
2. Chemical and Waste Storage Bunds:
   • The 110% / 25% Rule: Does the secondary containment hold at least 110% of the capacity of the largest container or 25% of the total aggregate volume stored (whichever is greater)?
   • Are rainwater valves in bunds kept closed and padlocked, or are they left open to drain oily runoff into soil?
   • Are incompatible chemicals stored together (e.g., strong acids next to cyanides, or oxidizers next to flammable solvents)?
3. Atmospheric Abatement Systems:
   • Are baghouse dust collectors pulsing properly, or are exhaust stacks showing visible particulate plumes?
   • Check scrubber differential pressure gauges—do readings match specified operational ranges in operating procedures?
4. Stormwater Runoff and Interceptors:
   • Inspect final interceptor chambers. Is there visible hydrocarbon sheen, sludge accumulation, or chemical odor?
   • Are isolation penstock valves operable and identified on the facility drainage plan?

---

Reconciling Conflicting Evidence: What to Do When Evidence Clashes

Discrepancies frequently occur when verbal statements contradict physical reality or documented records. Consider these two fundamental scenarios:

Scenario A: Verbal Claim Complies, but Physical Observation Contradicts

• Interview: The Operations Director claims that spent transformer oil containing PCBs was decommissioned and removed five years ago.
• Physical Observation: In a disused back lot, the auditor observes three rusted 200-liter drums labeled "Aroclor - PCB Oil" leaking onto permeable gravel.
• Auditor Protocol: Physical reality takes precedence over verbal statements. The auditor photographs the drums, notes the drum serial numbers, samples the maintenance log, and raises a critical nonconformity. The verbal assertion is noted in audit notes to highlight a breakdown in leadership awareness (Clause 5.1).

Scenario B: Document Complies, but Physical Observation Contradicts

• Document: The preventative maintenance register shows that the activated carbon filter on the VOC exhaust stack was replaced on August 1st.
• Physical Observation: The auditor inspects the physical filter housing and observes the manufacturer's original seal intact with a manufacture date stamped from three years prior, covered in thick undisturbed grime.
• Auditor Protocol: This indicates either falsification of records or severe maintenance misidentification. The auditor does not accuse anyone of fraud; instead, the auditor objectively records the physical serial number, presents both the document and physical finding to the guide, and requests corroboration. This constitutes an objective nonconformity under Clause 8.1 / 7.5.

---

Comprehensive Auditor Evidence Gathering Strategy Table

---

Realistic Audit Scenario: The Solvent Balance Discrepancy

Scenario: During an environmental audit of a furniture finishing plant, the EHS Manager presents the annual Solvents Management Plan, stating that the facility consumed 4.2 tons of volatile solvent in 2025 and that all VOC emissions were captured and incinerated by the thermal oxidizer with 98% efficiency.

The auditor performs an evidence triangulation check:

1. Document Review: The auditor reviews raw chemical purchase invoices from the accounting department and discovers total purchases of 12.8 tons of solvent during 2025.
2. Waste Records Review: The hazardous waste disposal manifests account for only 1.5 tons of liquid solvent waste sent for off-site recovery.
3. Calculation: 12.8 tons purchased minus 1.5 tons waste leaves 11.3 tons utilized. The EHS report accounted for only 4.2 tons entering the oxidizer.
4. Site Walk & Interview: The auditor walks the spray-booth line and interviews three spray operators. The operators explain that due to inadequate booth draft, they frequently open all side bay doors and clean spray guns over open plastic buckets behind the factory using rags, allowing the solvent to evaporate into the outdoor air.

Lead Auditor Evaluation: The auditor has uncovered substantial unmonitored fugitive VOC emissions escaping regulatory limits. The triangulation of accounting invoices, waste manifests, operator interviews, and physical observation proves that the facility's aspect identification (Clause 6.1.2), operational controls (Clause 8.1), and compliance evaluation (Clause 9.1.2) are systematically defective.