4.2 Substantive Testing & Substantive Analytical Procedures (ISA 520)

4.2 Substantive Testing & Substantive Analytical Procedures (ISA 520)

Core Principle: Substantive testing forms the empirical core of financial statement verification. While tests of controls evaluate whether an organization's internal defensive mechanisms work, substantive procedures directly verify whether the recorded figures are true, complete, and legally valid. Under ISA 520 and ISSAI 2520, substantive analytical procedures offer a powerful, highly efficient testing methodology when plausible, predictable relationships exist between financial and non-financial information.

---

The Architecture of Substantive Procedures

Under ISA 330 (The Auditor's Responses to Assessed Risks), the auditor must design and perform substantive procedures for each material class of transactions, account balance, and disclosure, irrespective of the assessed risks of material misstatement. Substantive procedures are categorized into two fundamental operational types:

1. Tests of Details (ToD)

Tests of details involve the granular examination of individual line items, supporting vouchers, physical assets, and third-party confirmations. Tests of details are divided into:

• Tests of Transactions: Examining the individual debit and credit entries flowing through an account during the period (e.g., vouching individual procurement invoices to delivery receipts and tender awards).
• Tests of Balances: Examining the cumulative ending balance comprising an account at year-end (e.g., sending direct debtor confirmations or inspecting physical warehouse inventory).
• Tests of Disclosures: Verifying the accuracy, completeness, and clarity of narrative notes, commitments, and contingent liabilities in the financial report.

2. Substantive Analytical Procedures (SAP)

Substantive analytical procedures consist of evaluations of financial information made by an analysis of plausible relationships among both financial and non-financial data. They encompass comparisons of recorded amounts to independent expectations developed by the auditor.

---

The Four-Step Methodology for Substantive Analytical Procedures (ISA 520)

ISA 520.5 imposes a rigorous, four-stage protocol that auditors must execute and document when performing substantive analytical procedures:

               THE MANDATORY 4-STEP SAP FRAMEWORK (ISA 520)

    +-------------------------------------------------------------------+
    | STEP 1: Determine Suitability of SAP for Given Assertions         |
    | Evaluate predictability of account, transaction volume, and risk  |
    +-------------------------------------------------------------------+
                                  |
                                  v
    +-------------------------------------------------------------------+
    | STEP 2: Evaluate the Reliability of Underlying Data               |
    | Assess source, independence, comparability, and internal controls |
    +-------------------------------------------------------------------+
                                  |
                                  v
    +-------------------------------------------------------------------+
    | STEP 3: Develop an Independent Expectation & Assess Precision     |
    | Formulate mathematical model based on reliable operating drivers  |
    +-------------------------------------------------------------------+
                                  |
                                  v
    +-------------------------------------------------------------------+
    | STEP 4: Compare, Evaluate Threshold & Investigate Differences     |
    | Quantify difference; if > Threshold, inquire and corroborate      |
    +-------------------------------------------------------------------+

Step 1: Determine the Suitability of SAP for Given Assertions

The auditor must evaluate whether analytical procedures are appropriate for the specific assertion. Suitability depends on:

• Predictability of Relationships: Analytical procedures are particularly suitable for routine, recurring transactions that exhibit stable relationships over time (e.g., payroll expense, depreciation charges, standard office rental leases, or utility costs). They are unsuitable for volatile, non-routine, or highly subjective transactions (e.g., restructuring provisions, legal settlement claims, or specialized emergency procurement).
• Assessed Risk of Material Misstatement: When the assessed RMM is high, or when a significant risk exists, professional standards prohibit the auditor from relying solely on substantive analytical procedures; tests of details must be incorporated into the substantive response.

Step 2: Evaluate the Reliability of Underlying Data

An expectation is only as credible as the data used to construct it. The auditor must evaluate the reliability of data by considering:

• Source of Information: Data obtained from independent sources outside the entity (e.g., published regulatory salary grids, statutory tax rates, external market indices) is more reliable than internal data.
• Comparability: Whether the data is comparable across reporting periods or industry benchmarks.
• Nature and Relevance: Whether the operational metrics directly drive the financial figures (e.g., building floor space directly driving facility heating expenses).
• Controls Over Data Preparation: If the data is generated internally (such as headcount logs or student enrollment counts), the auditor must test the operating effectiveness of the general and application IT controls governing the production of that data.

Step 3: Develop an Independent Expectation and Assess Its Precision

The auditor must develop an independent expectation of recorded amounts or ratios. The expectation must be sufficiently precise to identify a misstatement that, individually or when aggregated with other misstatements, could cause the financial statements to be materially misstated.

• Precision is the measure of the closeness of the auditor's expectation to the true underlying amount. Precision is influenced by the level of detail or disaggregation (e.g., monthly disaggregated payroll analysis by staff grade is far more precise than an annual total organization headcount average) and the completeness of independent variables incorporated into the model.

Step 4: Determine the Acceptable Difference Threshold and Investigate Significant Deviations

The auditor determines the maximum difference between the recorded amount and the independent expectation that can be accepted without further investigation. This threshold is heavily calibrated against Performance Materiality (typically set at a fraction of performance materiality, such as 15% to 25%, to prevent aggregation risk).

If the observed difference exceeds the acceptable threshold, ISA 520.7 requires the auditor to investigate the difference by:

1. Inquiring of management and obtaining prompt explanations.
2. Obtaining independent audit evidence to corroborate management's oral explanations. Management's uncorroborated assertions regarding reasons for variance are never sufficient.
3. Performing other audit procedures if management cannot provide a satisfactory explanation or if corroborating evidence is lacking.

---

The Spectrum of Analytical Techniques

Auditors employ four primary analytical techniques, ranging from simple comparative reviews to advanced mathematical models:

---

Comparing Analytical Procedures Across the Three Audit Stages

A classic area of examination testing centers on the distinct roles and regulatory requirements of analytical procedures across the three phases of an audit engagement:

                  ANALYTICAL PROCEDURES ACROSS THE THREE STAGES

    STAGE 1: Risk Assessment (Planning)  ---> MANDATORY (ISA 315)
    -----------------------------------
    * Level of Aggregation: High / Broad
    * Primary Objective: Identify unusual transactions, unexpected trends, and RMM
    * Outcome: Informs the audit plan and resource allocation

    STAGE 2: Substantive Testing         ---> DISCRETIONARY / OPTIONAL (ISA 520)
    ----------------------------
    * Level of Aggregation: Highly Disaggregated / Precise
    * Primary Objective: Obtain direct substantive evidence to reduce detection risk
    * Outcome: Corroborates specific assertions (e.g., Accuracy, Completeness)

    STAGE 3: Final Overall Review        ---> MANDATORY (ISA 520)
    -----------------------------
    * Level of Aggregation: High / Financial Statement Level
    * Primary Objective: Confirm financial statements are consistent with auditor's knowledge
    * Outcome: Evaluates whether overall conclusions remain sound

---

Practical EU Audit Case: Reasonableness Test on Erasmus+ Mobility Grants

An audit team is examining total annual disbursements of EUR 45,000,000 under the Erasmus+ student mobility program administered by a National Agency:

1. Data Gathering: The agency reports 90,000 completed student-mobility months during the academic year. The auditor obtains the official European Commission Erasmus+ grant tariff table, which fixes the flat-rate monthly allowance at exactly EUR 500 per student.
2. Data Reliability Verification: The auditor tests automated controls within the IT mobility database, verifying that student participation records are validated by receiving university exchange transcripts.
3. Expectation Formulation: The auditor constructs an independent mathematical expectation: $\text{Expected Expenditure} = 90,000 \text{ mobility months} \times \text{EUR } 500 = \text{EUR } 45,000,000$
4. Comparison & Threshold: The auditor established an acceptable threshold of EUR 250,000. The recorded disbursement is EUR 45,180,000. The difference is EUR 180,000 (well within the EUR 250,000 threshold). The auditor concludes that total expenditure is materially accurate and substantively verified without examining tens of thousands of individual student bank transfers.