9.2 AQUA Software & Case Review Methodology

9.2 AQUA Software & Case Review Methodology

Quick Answer: The AQUA (Advanced Quality Assurance) software engine is the automated audit and reporting system certified by the IAED to evaluate telecommunicator compliance with the Medical Priority Dispatch System (MPDS). IAED standards set the minimum audit volume on a sliding scale tied to annual call volume, published as the Academy Minimum Case Review Standards and calculated by the IAED Case Review Calculator: centers below 1,300 annual calls audit 100% of cases; centers between 1,300 and 43,332 audit 1,300 cases (25 per week); centers between 43,333 and 500,000 audit a percentage sliding from 3% down to 1%; and centers above 500,000 audit 1%. Case review scores seven protocol components: (1) Case Entry interrogation, (2) Chief Complaint selection, (3) Key Question interrogation, (4) Dispatch Life Support Instructions provision (PDIs and PAIs), (5) Diagnostic and Instruction Tools, (6) Final Coding, and (7) Customer Service. AQUA eliminates subjective grading by measuring performance against rigid, physician-validated compliance formulas.

---

The AQUA Engine: Architecture and Integration

Prior to the advent of specialized dispatch quality software, agencies audited calls using physical paper checklists and manual spreadsheet scoring. This manual workflow suffered from severe inconsistencies: reviewers applied conflicting interpretations of protocol rules, calculation errors distorted monthly averages, and pulling call recordings was labor-intensive.

To standardize audit mechanics globally, Priority Dispatch Corp. and the IAED developed AQUA (Advanced Quality Assurance). AQUA is a sophisticated clinical auditing application engineered to synchronize directly with the computerized protocol engine (ProQA) and the agency's Computer-Aided Dispatch (CAD) and digital logging recorder (DLR) audio databases.

Technical and Analytical Capabilities of AQUA

• Keystroke and Timestamp Synchronization: AQUA links the exact acoustic recording of the 9-1-1 call with the millisecond-by-millisecond keystrokes recorded in ProQA. The evaluator sees precisely when questions appeared on the dispatcher's monitor, when the dispatcher selected answers, when field units were notified in CAD, and when instructions were delivered.
• Algorithmic Logic Verification: AQUA evaluates whether the telecommunicator navigated the protocol branches correctly based on the caller's answers. If an EMD selected an answer that should have triggered a specific sub-question but bypassed it, AQUA automatically flags the omission.
• Automated Score Tabulation: Compliance percentages for individual calls, shifts, and the entire communications center are computed automatically using IAED-validated mathematical weighting formulas, eliminating manual grading discrepancies.
• Standardized Data Export: AQUA compiles multi-year performance databases required for submission during IAED Accredited Center of Excellence (ACE) applications and recertifications.

---

Case Review Sampling Standards & Mathematical Validity

For a quality assurance program to reflect an agency's clinical performance accurately, the case review sample must be statistically defensible, drawn at random, and operationally comprehensive.

The Academy Minimum Case Review Standards

The Academy's current standard is a sliding scale keyed to annual call volume per discipline, not a flat percentage. Prior to 1997 the standard was a fixed 7% of all cases; it was revised so that very large centers were not required to audit an unmanageable number of calls while very small centers still produce a statistically meaningful sample.

+--------------------------------------------------------------------------+
|            ACADEMY MINIMUM CASE REVIEW STANDARDS (per discipline)        |
|                                                                          |
|   Annual call volume BELOW 1,300         -> audit 100% of cases          |
|   Annual call volume 1,300 - 43,332      -> audit 1,300 cases            |
|                                             (25 cases per week)          |
|   Annual call volume 43,333 - 500,000    -> audit a sliding percentage   |
|                                             between 3% and 1%            |
|   Annual call volume ABOVE 500,000       -> audit 1% of cases            |
|                                                                          |
|   The exact number is produced by the IAED Case Review Calculator,       |
|   available in AQUA and on the Academy website, in both annual and       |
|   monthly formats.                                                       |
+--------------------------------------------------------------------------+

Two requirements sit behind that scale. First, the sample must be large enough to support inferences about the whole population of calls. Second, each individual EMD must receive enough feedback for the process to feel legitimate to them — which is why accredited centers also review an approximately equal number of calls for every calltaker rather than simply drawing at random across the center.

Worked example: an agency answering 40,000 emergency medical calls a year
falls in the 1,300 - 43,332 band, so its minimum is 1,300 cases per year
(25 per week, roughly 108 per month).

With 10 active EMDs, that is about 11 reviewed calls per dispatcher per
month - and the agency must confirm the split is roughly equal across all
ten, across every shift, rather than concentrated on a few individuals.

Equitable Temporal and Shift Distribution

Auditing must not be concentrated during convenient administrative hours. True random sampling requires calls to be drawn proportionally across:

• All Operational Shifts: Day, swing, evening, and graveyard (overnight) shifts.
• All Days of the Week: Weekdays, weekends, and observed public holidays.
• All Active Calltaking Personnel: Every certified telecommunicator who processes medical calls must be audited every month. No individual—regardless of seniority, supervisory status, or part-time scheduling—may be exempted from monthly review.

100% Review of High-Risk Sentinel Events

In addition to the unmanipulated random sample, accredited agencies institute focused case review — in most centers a 100% review — for specific time-critical, high-liability clinical presentations known as sentinel calls:

• All calls processed under Protocol 9 (Cardiac or Respiratory Arrest / Death)
• All calls involving Telephone CPR (T-CPR) delivery or bystander AED deployment
• All calls on Protocol 11 involving complete Foreign Body Airway Obstruction (choking)
• All calls on Protocol 24 involving imminent childbirth or obstetric complications
• High-acuity pediatric submersions, penetrating chest/abdominal trauma, and anaphylaxis

Note: Sentinel calls reviewed for clinical oversight are tracked separately from the random sample so the random baseline is not skewed by a disproportionate share of high-acuity incidents. The IAED accreditation application asks agencies to describe exactly this — how cases are randomly selected, the minimum number reviewed monthly, and any focused case review practices such as cardiac arrest, choking, and childbirth.

---

The Seven Protocol Components Evaluated in AQUA

The Academy defines seven protocol components, each weighted according to its clinical importance by the Board of Accreditation and maintained by the Academy's ED-Q Standards Board. AQUA applies that weighting automatically:

1. Case Entry interrogation
2. Chief Complaint selection
3. Key Question interrogation
4. Dispatch Life Support Instructions provision (PDIs & PAIs)
5. Diagnostic and Instruction Tools
6. Final Coding
7. Customer Service

Candidates frequently remember only the first four and Final Coding. The two most commonly forgotten are Diagnostic and Instruction Tools — the scored use of the Agonal Breathing Detector, the Stroke Diagnostic, the Aspirin Diagnostic, the Contraction Timer and the Pulse Check — and Customer Service, which scores the EMD's communication skills, attitude, and the overall impression conveyed to the caller.

---

Category 1: Case Entry Compliance

Case Entry evaluates the universal gateway protocol that initiates every call. Scored elements include:

• Address Verification: Immediate, unambiguous verification of the incident location before interrogating medical symptoms.
• Callback Number: Confirmation of the telephone number.
• Verbatim Chief Complaint Phrasing: Asking "Okay, tell me exactly what happened" without paraphrasing or leading questions.
• Patient Age Verification: Eliciting or accurately estimating age.
• Consciousness and Breathing Assessment: Asking "Is s/he awake?" and "Is s/he breathing?" verbatim, and properly identifying abnormal breathing presentations (including agonal respirations).

Category 2: Chief Complaint Selection Compliance

Chief Complaint Selection assesses whether the EMD navigated to the single most appropriate protocol (Protocols 1 through 36) based on the inciting incident and primary symptom. Scored criteria include:

• Selecting the Inciting Mechanism vs. Resulting Symptom: Proper selection when trauma and medical conditions overlap (e.g., selecting Protocol 10 for chest pain that caused a secondary minor vehicle collision).
• Correct Rule and Axiom Application: Adhering to the Rules and Axioms printed on each protocol and to the Chief Complaint Selection Rules in Case Entry, which govern which complaint wins when two plausible protocols compete.
• Avoiding Premature Protocol Hopping: Remaining on the correct protocol unless an explicit protocol shunt is mandated.

Category 3: Key Questions Compliance

Key Questions assess the structured interrogation phase that determines clinical acuity. Scored criteria include:

• Verbatim Delivery: Reading questions word-for-word as scripted in ProQA without omissions, substitutions, or unauthorized additions.
• Adherence to Logic Branching: Asking all questions mandated by the patient's age, chief complaint, and prior answers.
• Clarifying Ambiguous Answers: Seeking clarification when callers provide vague responses before recording an answer.
• Pre-Question Dispatch Adherence: Triggering initial dispatch at the mandated breakpoint rather than unnecessarily holding calls until all Key Questions are finished.

Category 4: Dispatch Life Support (DLS) Compliance

Dispatch Life Support represents the clinical intervention phase, evaluated across two distinct components:

• Post-Dispatch Instructions (PDIs): Immediate scene-safety and patient-preparation instructions (e.g., unlocking doors, gathering medications, turning on outside porch lights, securing aggressive animals).
• Pre-Arrival Instructions (PAIs): Scripted medical treatments delivered to untrained callers (e.g., Telephone CPR, airway clearing, choking relief, tourniquet application, emergency childbirth coaching). Scoring assesses verbatim delivery, instructional pacing, cadence counting during CPR, and managing caller reluctance.

Category 5: Diagnostic and Instruction Tools

Diagnostic and Instruction Tools are the specific question or instruction sequences used to evaluate or treat a particular condition, and they are scored in their own right:

• Agonal Breathing Detector — launched when the caller's description of breathing is ambiguous in an unconscious patient.
• Stroke Diagnostic — administered and recorded when Protocol 28 or 18 is selected, including the first-party version added in MPDS v14.
• Aspirin Diagnostic — the contraindication screen before any aspirin instruction on Protocol 10.
• Contraction Timer and Pulse Check — the obstetric and cardiac timing tools.

Scoring assesses whether the correct tool was launched, launched at the right point, and completed rather than abandoned partway through.

Category 6: Final Coding Compliance

Final Coding evaluates whether the resulting triage determinant code (e.g., 10-D-4, 28-C-5, 9-E-1) represents an accurate mathematical and clinical output of the answers entered. Scored criteria include:

• Determinant Level Accuracy: Ensuring the correct priority tier (OMEGA, ALPHA, BRAVO, CHARLIE, DELTA, ECHO) was generated.
• Sub-Determinant Code Validity: Correctly identifying the specific clinical qualifier (for example, on Protocol 10, 1 Not alert versus 4 Clammy or cold sweats).
• Suffix and Modifier Application: Accurately appending the protocol's own suffix (for example Protocol 27's G/S mechanism letters, Protocol 17's P public place, or Protocol 9's death-criteria letters).

Category 7: Customer Service

Customer Service evaluates the EMD's communication skills, attitude, and the overall impression conveyed to the caller: tone, professionalism, the absence of dismissive or argumentative language, and whether the caller was left confident that help was coming. A call can be flawless on protocol and still lose points here — and a serious failure to act on an obvious risk the caller describes is captured as a failure to meet the minimum Standards of Practice.

---

AQUA Performance Metrics Reference Matrix

---

Automated Reporting and Trend Analysis

AQUA compiles individual call reviews into macro-level organizational dashboards. These reports allow agency administrators and Medical Directors to track clinical trends over time:

• Individual Performance Records: Monthly report cards provided to each telecommunicator showing compliance percentages across all seven components, highlighting strengths and identifying specific areas requiring educational coaching.
• Agency-Wide Category Scores: Macro-benchmarking demonstrating whether the overall communications center meets or exceeds IAED standards across shifts.
• Protocol-Specific Compliance Profiles: Pinpointing specific protocols with recurring variances. For example, if Protocol 28 (Stroke) consistently shows an 84% Key Question compliance rate agency-wide, the training division recognizes that dispatchers require refresher training on the Cincinnati Stroke Scale questions.
• Statistical Process Control (SPC): AQUA dashboards distinguish between isolated errors (special-cause variation) and systemic procedural breakdowns (common-cause variation), ensuring training resources are targeted effectively.

---

Realistic Case Review Audit in AQUA: Step-by-Step Breakdown

The Incident Record: Call #2026-08492

• Incident Type: Suspected Acute Stroke
• Dispatcher ID: Telecommunicator #412
• Reviewer: EMD-Q Marcus Vance
• Audio Duration: 3 minutes 42 seconds

AQUA Section Scoring Breakdown

1. Case Entry Evaluation: Score = 100% (High Compliance)

   • EMD verified address and callback number immediately.
   • Scripted question "Okay, tell me exactly what happened" read verbatim.
   • Patient confirmed as 68-year-old female, awake and breathing normally.
   • Audit Finding: Flawless Case Entry execution; initial dispatch transmitted at 28 seconds.

2. Chief Complaint Selection: Score = 100% (High Compliance)

   • Caller reported sudden facial drooping and right-side arm weakness.
   • EMD selected Protocol 28 (Stroke / CVA) in ProQA.
   • Audit Finding: Accurate protocol selection, consistent with the Case Entry Chief Complaint Selection Rules.

3. Key Questions Evaluation: Score = 91.2% (Compliant)

   • Question 1 ("Is she completely alert?") read verbatim.
   • Question 2 ("Can she smile or show her teeth?") read verbatim.
   • Question 3 ("Can she raise both arms above her head?"): Dispatcher paraphrased as "Can she lift her hands up?"
   • Audit Finding: Minor/Moderate deviation noted on Question 3. Paraphrasing "raise both arms above her head" to "lift her hands up" alters the biomechanical specificity of the pronator drift diagnostic test. Scored as a deviation in AQUA.

4. Dispatch Life Support Evaluation: Score = 100% (High Compliance)

   • All PDIs delivered verbatim: "Do not give her anything to eat or drink", "Have her rest in the most comfortable position", and "Unlock the front door."
   • Audit Finding: Excellent tone, authoritative delivery, and clear confirmation from caller.

5. Diagnostic and Instruction Tools: Score = 100% (High Compliance)

   • Stroke Diagnostic launched at the correct point in Key Questions and carried to completion.
   • Audit Finding: Tool used correctly; result recorded in the suffix.

6. Final Coding Evaluation: Score = 100% (High Compliance)

   • Generated Determinant Code: 28-C-5 (Sudden paralysis or facial droop) with the Stroke Diagnostic suffix for clear evidence, less than 2 hours since symptoms started.
   • Audit Finding: The sub-determinant matched the documented deficit and the suffix matched the documented Stroke Diagnostic result and time band.

7. Customer Service: Score = 100% (High Compliance)

   • Calm, professional tone throughout; caller repeatedly reassured that help was on the way.

Overall Call Compliance Score: 96.4% (High Compliance) Action Plan: Schedule a brief 5-minute educational coaching session to review the diagnostic necessity of using the exact scripted wording for the Stroke Diagnostic arm-drift assessment.