Specification Calculations and Operating Qualifiers

Worked Multi-Term Specification Calculation

To see how these terms combine in practice, consider the following calibration scenario:

Problem Statement

A calibration technician is verifying a hypothetical precision Digital Multimeter on its $10.00000\text{ V}$ DC range. The ambient laboratory temperature is $23.0^\circ\text{C}$, and the instrument was calibrated 8 months ago. The manufacturer's 1-year specification sheet states:

$$\text{Accuracy} = \pm (0.0035\% \text{ of reading} + 0.0005\% \text{ of range} + 2 \text{ counts})$$

The technician applies a nominal standard voltage of $2.50000\text{ V}$. Calculate the total absolute Maximum Permissible Error (MPE) in microvolts and the equivalent relative error at this calibration point.

Step-by-Step Solution

1. Calculate the Proportional Reading Term:

$$\text{Term}_1 = 2.50000\text{ V} \times \frac{0.0035}{100} = 2.50000\text{ V} \times 3.5 \times 10^{-5} = 8.75 \times 10^{-5}\text{ V} = 87.5\ \mu\text{V}$$

1. Calculate the Range Term:

$$\text{Term}_2 = 10.00000\text{ V} \times \frac{0.0005}{100} = 10.00000\text{ V} \times 5.0 \times 10^{-6} = 5.0 \times 10^{-5}\text{ V} = 50.0\ \mu\text{V}$$

1. Calculate the Floor Count Term: On the $10.00000\text{ V}$ range, the display resolves $0.00001\text{ V} = 10\ \mu\text{V}$ per count.

$$\text{Term}_3 = 2 \text{ counts} \times 10\ \mu\text{V/count} = 20.0\ \mu\text{V}$$

1. Sum the Components to Find Total Absolute MPE:

$$\text{MPE}_{\text{abs}} = \pm (87.5\ \mu\text{V} + 50.0\ \mu\text{V} + 20.0\ \mu\text{V}) = \pm 157.5\ \mu\text{V}$$

1. Compute Equivalent Relative Error at $2.5\text{ V}$:

$$\text{Relative MPE} = \frac{157.5\ \mu\text{V}}{2.50000\text{ V}} \times 100\% = \frac{157.5 \times 10^{-6}\text{ V}}{2.5\text{ V}} \times 100\% = \pm 0.0063\% = \pm 63\text{ ppm}$$

Notice that if the technician measured $10.00000\text{ V}$ (full range), the total MPE would be $\pm (350.0 + 50.0 + 20.0)\ \mu\text{V} = \pm 420.0\ \mu\text{V}$, which corresponds to $\pm 42\text{ ppm}$. The relative error increases from $42\text{ ppm}$ at full scale to $63\text{ ppm}$ at one-quarter scale due to the influence of the fixed floor terms.

---

Tolerance vs. Specification

In metrology, the terms specification and tolerance are not interchangeable. Confusing them can lead to flawed calibration decisions and miscalculated risk.

---

Baseline Modifiers and Qualifiers

Manufacturer specifications are valid only under defined environmental, temporal, and electrical operating conditions. Calibration technicians must adjust specifications when instruments operate outside these baseline qualifiers.

Time-based accuracy specifications

A datasheet may provide 24-hour, 90-day, one-year, or other time-based limits. These are performance terms under stated conditions, not universal calibration intervals. Select the term covering the time since calibration and the application conditions. Interval selection also uses observed stability, checks, usage, consequences, and the equipment program.

Operating Temperature Bands and Temperature Coefficients ($T_{\text{coeff}}$)

Precision electronic and dimensional standards are calibrated at a reference temperature—typically $23.0^\circ\text{C} \pm 1.0^\circ\text{C}$ or $20.0^\circ\text{C} \pm 0.5^\circ\text{C}$. Most manufacturers specify baseline accuracy within an operational temperature band, typically:

$$\text{Operating Band} = 23^\circ\text{C} \pm 5^\circ\text{C} \quad (18^\circ\text{C} \text{ to } 28^\circ\text{C})$$

When an instrument operates outside this band ($T < 18^\circ\text{C}$ or $T > 28^\circ\text{C}$), the technician must calculate and add a temperature coefficient adder:

$$\Delta T_{\text{outside}} = \begin{cases} 18^\circ\text{C} - T_{\text{ambient}}, & \text{if } T_{\text{ambient}} < 18^\circ\text{C} \\ T_{\text{ambient}} - 28^\circ\text{C}, & \text{if } T_{\text{ambient}} > 28^\circ\text{C} \end{cases}$$ $$\text{MPE}_{\text{total}} = \pm (B_{\text{base}} + |T_{\text{coeff}}|\Delta T_{\text{outside}})$$

Here $B_{\text{base}}$ is the positive magnitude of the base error bound. Apply only the adders and operating limits specified by the manufacturer; a temperature coefficient does not authorize use beyond a rated range. The example band below is hypothetical, not universal.

Worked Temperature Coefficient Calculation

A precision calibrator has a baseline 1-year accuracy of $\pm 50\text{ ppm}$ within $18^\circ\text{C}\text{ to }28^\circ\text{C}$. The manufacturer states a temperature coefficient of $\pm(5\text{ ppm}/^\circ\text{C})$ for temperatures outside this range. If used in a manufacturing cleanroom operating at $33^\circ\text{C}$:

1. Calculate temperature departure beyond the operating band:

$$\Delta T_{\text{outside}} = 33^\circ\text{C} - 28^\circ\text{C} = 5^\circ\text{C}$$

1. Calculate the temperature coefficient adder:

$$\text{Adder} = 5\text{ ppm}/^\circ\text{C} \times 5^\circ\text{C} = 25\text{ ppm}$$

1. Calculate the adjusted operational specification:

$$\text{MPE}_{\text{adjusted}} = \pm (50\text{ ppm} + 25\text{ ppm}) = \pm 75\text{ ppm}$$

---

Output and Scale Terms

Process instrumentation, sensors, and transmitters use specialized scale terminology to define operational spans and input-output transfer functions:

• Sensitivity: The ratio of the change in instrument output to the corresponding change in physical input (the slope of the calibration curve):

$$S = \frac{\Delta \text{Output}}{\Delta \text{Input}}$$

Examples: a strain gauge load cell with a sensitivity of $2.000\text{ mV/V at full scale}$, or a thermocouple yielding $41.27\ \mu\text{V}/^\circ\text{C}$.

• Full Span: The algebraic difference between the upper range limit and lower range limit:

$$\text{Span} = \text{URL} - \text{LRL}$$

• Zero Elevation: Applied when the zero value of the measured variable is greater than the lower range limit (the lower range limit is negative or below the datum line). Commonly used in closed-tank liquid level systems with wet reference legs.
• Zero Suppression: Applied when the zero value of the measured variable is less than the lower range limit (the lower range limit is positive or above atmospheric datum). For example, a boiler pressure monitor calibrated to indicate between $+100\text{ psig}$ and $+500\text{ psig}$ has a suppressed zero of $100\text{ psig}$.
• Turndown Ratio (Rangeability): The ratio of the maximum allowable upper range limit (URL) of a smart transmitter to the minimum span to which the instrument can be adjusted while maintaining specified performance:

$$\text{Turndown Ratio} = \frac{\text{URL}_{\text{max}}}{\text{Calibrated Span}}$$

For example, if a pressure transmitter has a maximum $\text{URL} = 1000\text{ psi}$ and is calibrated to operate over a span of $50\text{ psi}$, the turndown ratio is $1000 / 50 = 20:1$. High turndown ratios often degrade accuracy because the base sensor noise and hysteresis represent a larger percentage of the contracted span.

---

Common Metrological Error Traps