6.1 SAS Array Processing for Multi-Variable Transformations

6.1 SAS Array Processing for Multi-Variable Transformations

In real-world data engineering and analytics, datasets frequently contain groups of related variables representing repetitive measurements across time, categories, or survey items—such as monthly sales (Sales_Jan through Sales_Dec), quarterly revenues (Qtr1 through Qtr4), or psychometric test items (Item1 through Item50). Writing individual assignment statements or conditional logic for dozens of columns is inefficient, error-prone, and difficult to maintain.

SAS array processing allows programmers to group multiple variables under a single collective name and perform repetitive operations using iterative DO loops. Understanding how SAS handles arrays in memory during DATA step processing is a core requirement for the SAS Base Programming Specialist exam (A00-231).

---

1. What is a SAS Array?

It is vital to understand what a SAS array is and what it is not:

• What it is: A SAS array is a temporary grouping of SAS variables defined strictly within the context of a single DATA step. It provides an alternative, indexed method for referencing variables in memory during DATA step execution.
• What it is NOT: A SAS array is not a physical data structure, table, or variable stored in the output SAS dataset descriptor. Once the DATA step finishes executing, the array structure vanishes, leaving only the underlying dataset variables.

/* Traditional non-array approach to recalculate 4 quarterly figures */
data work.sales_adjusted;
    set work.sales_raw;
    Qtr1 = Qtr1 * 1.05;
    Qtr2 = Qtr2 * 1.05;
    Qtr3 = Qtr3 * 1.05;
    Qtr4 = Qtr4 * 1.05;
run;

/* Equivalent array processing approach */
data work.sales_adjusted;
    set work.sales_raw;
    array qtr{4} Qtr1-Qtr4;
    do i = 1 to 4;
        qtr{i} = qtr{i} * 1.05;
    end;
    drop i; /* Drop loop index variable from output dataset */
run;

---

2. ARRAY Statement Syntax & Subscript Declaration

The ARRAY statement is a compile-time statement that defines the array name, dimensions, element type, variable elements, and optional initial values.

General Syntax

ARRAY array_name {dimension} [$] [length] [variable_list] [(initial_values)];

• Brackets/Parentheses/Braces: Array subscripts can be enclosed in curly braces { }, square brackets [ ], or parentheses ( ). Braces or square brackets are widely preferred to visually distinguish array references from SAS functions.
• Dimensioning Methods:
  1. Explicit Integer Count: Specifying a fixed number of elements, e.g., {4} or {12}.
  2. Explicit Range: Specifying a starting and ending index, e.g., {1995:2025} or {-5:5}. This allows non-1 lower bounds.
  3. Asterisk [*] Notation: Instructs SAS to automatically count the number of variables listed in variable_list during compilation.

/* Example of non-standard lower bounds */
data work.temperature_anomaly;
    set work.climate_data;
    /* Access using actual calendar year as index */
    array temp{2020:2024} Temp2020-Temp2024;
    do yr = 2020 to 2024;
        if temp{yr} > 100 then ExtremeHeat_Flag = 1;
    end;
run;

---

3. Variable List Shortcuts in Arrays

When declaring arrays, SAS provides special variable list shortcuts to streamline code authoring:

1. Numbered Range Lists: Qtr1-Qtr4 expands to Qtr1, Qtr2, Qtr3, Qtr4. Requires digits to be sequential.
2. Name Range Lists: sales_jan--sales_dec includes all variables positioned between sales_jan and sales_dec in the Program Data Vector (PDV) order.
3. Type Special Lists:
   • _NUMERIC_: Includes all numeric variables previously compiled in the PDV.
   • _CHARACTER_: Includes all character variables previously compiled in the PDV.
   • _ALL_: Includes all variables (requires all variables in array to share data type).

Exam Tip: When using _NUMERIC_ or _CHARACTER_, the array only references variables that exist in the PDV prior to or at the point of the ARRAY statement. Variables created later in the DATA step are excluded.

---

4. Iterative DO Loops & Dynamic Array Bounds (DIM Function)

Hardcoding loop upper bounds (e.g., do i = 1 to 12;) introduces maintenance risks if variables are added or removed from the array list. The DIM() function evaluates the number of elements in an array dynamically at compilation and execution.

Array Bounds Functions

• DIM(array_name): Returns the total number of elements in the specified array dimension (defaults to 1st dimension).
• HBOUND(array_name): Returns the upper bound (highest index) of the array.
• LBOUND(array_name): Returns the lower bound (lowest index) of the array (crucial when index lower bound $\ne$ 1).

/* Dynamic Array Processing with DIM and LBOUND/HBOUND */
data work.survey_cleaned;
    set work.survey_raw;
    array response[*] Q1-Q25;
    
    /* Dynamically loop through all elements regardless of array size */
    do i = 1 to dim(response);
        /* Replace invalid survey values (-9, 99) with SAS missing value */
        if response{i} in (-9, 99) then response{i} = .;
    end;
    
    drop i;
run;

---

5. Temporary Arrays (_TEMPORARY_ Keyword)

In many analytical applications, you need array elements to store constants, baseline values, or intermediate calculations without saving those elements as columns in the final dataset. The _TEMPORARY_ keyword creates temporary data elements in memory.

Key Attributes of _TEMPORARY_ Arrays

1. No Dataset Variables: Elements do not correspond to existing or new variables in the output dataset. They exist only in RAM during DATA step execution.
2. Automatic Retention: Values in _TEMPORARY_ array elements are automatically retained across DATA step iterations (no explicit RETAIN statement needed).
3. High Performance: Eliminates PDV overhead and disk write operations, making lookup comparisons significantly faster.
4. Initialization Syntax: Specified using parentheses after _TEMPORARY_.

/* Benchmarking quarterly sales against fixed targets using a _TEMPORARY_ array */
data work.bonus_eligibility;
    set work.quarterly_sales;
    
    /* Define temporary target lookup table (Q1=1000, Q2=1200, Q3=1100, Q4=1500) */
    array targets{4} _TEMPORARY_ (1000, 1200, 1100, 1500);
    array sales{4} Qtr1-Qtr4;
    
    MetTarget_Count = 0;
    
    do i = 1 to dim(sales);
        if sales{i} >= targets{i} then MetTarget_Count + 1;
    end;
    
    drop i;
run;

---

6. Common Pitfalls & Exam Watchouts

• Subscript Out of Range: Referencing an index outside array bounds (e.g., qtr{5} when array dimension is 4) terminates DATA step execution with an ERROR: Array subscript out of range.
• Unwanted Index Variables: The index variable used in a DO loop (e.g., i in do i = 1 to dim(arr);) is added to the PDV and written to the output dataset unless dropped with DROP i; or defined as a temporary variable.
• Data Type Mismatch: An array must contain exclusively numeric variables or exclusively character variables. Mixing types in a single array causes a compilation error unless multiple dimensions or distinct arrays are defined.