1.3 Measurement Systems & Unit Conversions

1.3 Measurement Systems & Unit Conversions

US Customary and SI Metric Systems in Modern Quality Inspection

Global supply chains require quality inspectors to work fluently across two predominant measurement systems:

1. US Customary System (Inch-Pound): Historically derived from British Imperial measures, commonly used in North American aerospace, commercial manufacturing, and civil infrastructure. Primary dimensional units include the inch (in), foot (ft), and mil / thou (0.001 in).
2. International System of Units (SI Metric): A coherent, decimal-based system established by the General Conference on Weights and Measures (CGPM) and governed globally by the BIPM (Bureau International des Poids et Mesures).

Base Units and Derived Metrology Units

The SI system is built upon seven fundamental base units. For the CQI body of knowledge, four are directly applicable:

• Length: Meter (m)
• Mass: Kilogram (kg)
• Time: Second (s)
• Thermodynamic Temperature: Kelvin (K)

Derived units are formed by algebraic combinations of base units:

• Force: Newton (N), where $1\text{ N} = 1\text{ kg}\cdot\text{m/s}^2$. Used in pull testing, crimp tensile verification, and hardness test indenter loading.
• Pressure / Stress: Pascal (Pa), where $1\text{ Pa} = 1\text{ N/m}^2$. In materials testing, tensile and yield strengths are typically reported in Megapascals ($1\text{ MPa} = 10^6\text{ Pa} = 1\text{ N/mm}^2$) or kilopounds per square inch (ksi).
• Energy / Work: Joule (J), where $1\text{ J} = 1\text{ N}\cdot\text{m}$. Used in Charpy and Izod impact toughness testing.

Standard Metric Prefixes in Quality Control

Metric prefixes scale units by powers of ten, eliminating awkward numbers of trailing or leading zeros:

---

Exact Conversion Factors and Dimensional Conversions

Converting between customary and metric units requires exact mathematical factors to maintain gage calibration integrity.

The Exact Inch-to-Millimeter Standard

On July 1, 1959, the international standards organizations of the United States, United Kingdom, Canada, Australia, New Zealand, and South Africa adopted the International Yard and Pound Agreement, defining: $1\text{ inch} \equiv 25.4\text{ millimeters (exactly)}$ Because this definition is exact by treaty, $25.4$ has an infinite number of significant digits ($25.4000\dots$). From this exact definition: $1\text{ mm} = \frac{1}{25.4}\text{ in} \approx 0.0393700787\dots\text{ in} \approx 0.039370\text{ in}$

Microinch to Micrometer (Micron) Conversions

Surface texture callouts on American prints often specify roughness in microinches (μin), while ISO drawings specify micrometers (μm): $1\text{ inch} = 10^6\mu\text{in} = 25.4\text{ mm} = 25,400\mu\text{m}$ Dividing both sides: $1\mu\text{in} = 0.0254\mu\text{m (exactly)}$ $1\mu\text{m} = \frac{1}{0.0254}\mu\text{in} \approx 39.3701\mu\text{in} \approx 40\mu\text{in (rule of thumb)}$

• Shop Example: A blueprint calls for a ground seal surface with $R_a \le 16\mu\text{in}$. The shop profilometer reads in micrometers (μm). $\text{Target } R_a = 16\mu\text{in} \times 0.0254\mu\text{m}/\mu\text{in} = 0.4064\mu\text{m} \approx 0.40\mu\text{m}$

Dual Dimensioning and Conversion Procedures

When converting fractional or decimal drawing callouts:

1. Fractional Inch to Millimeter: Convert fraction to decimal inch first, then multiply by 25.4: $\frac{7}{16}\text{ in} = 0.4375\text{ in} \implies 0.4375 \times 25.4 = 11.1125\text{ mm}$
2. Tolerance Conversion Rule: Always convert the tolerance with at least the same degree of relative precision as the original specification.
   • If a tolerance is $+/- 0.001\text{ in}$: $0.001 \times 25.4 = \pm 0.0254\text{ mm}$ (rounded to $+/- 0.025\text{ mm}$).
   • If a tolerance is $+/- 0.0001\text{ in}$ ("one tenth"): $0.0001 \times 25.4 = \pm 0.00254\text{ mm}$ ($+/- 2.54\mu\text{m}$).

---

Temperature Scales and Thermal Expansion Metrology

Temperature is the single most pervasive environmental source of error in precision dimensional measurement.

Temperature Scale Conversions

Quality laboratories and shop floors monitor ambient conditions in degrees Fahrenheit (°F) or degrees Celsius (°C): $T_{^\circ\text{F}} = \left(\frac{9}{5} \times T_{^\circ\text{C}}\right) + 32 = (1.8 \times T_{^\circ\text{C}}) + 32$ $T_{^\circ\text{C}} = \frac{5}{9} \times (T_{^\circ\text{F}} - 32) = \frac{T_{^\circ\text{F}} - 32}{1.8}$

• Key Checkpoint: At what temperature do the scales read the same value? Setting $F = C$ yields $-40^\circ\text{F} = -40^\circ\text{C}$.

Standard Reference Temperature: 20°C (68°F)

Under ISO 1 and ASME B89.6.2, the international standard reference temperature for industrial length measurements is $20^\circ\text{C}$ ($68^\circ\text{F}$). All drawing dimensions, tolerances, and calibration certificates apply strictly at $20^\circ\text{C}$. When parts or measuring instruments deviate from this temperature, they expand or contract according to their material composition.

Linear Thermal Expansion Formula

The thermal growth or shrinkage of a dimension is calculated as: $\Delta L = L_0 \cdot \alpha \cdot \Delta T$ where:

• $\Delta L$ = Change in length (same units as $L_0$)
• $L_0$ = Nominal length at standard reference temperature
• $\alpha$ = Coefficient of Thermal Expansion (CTE), expressed in $\text{in/in/}^\circ\text{F}$ or $\text{mm/mm/}^\circ\text{C}$
• $\Delta T = T_{\text{actual}} - T_{\text{reference}}$ (where $T_{\text{ref}} = 68^\circ\text{F}$ or $20^\circ\text{C}$)

Typical Coefficients of Thermal Expansion (CTE)

Thermal Expansion Inspection Scenario: Differential Growth

An inspector checks a $10.0000\text{-inch}$ long 6061-aluminum housing on a shop floor where the temperature is $88^\circ\text{F}$ ($20^\circ\text{F}$ above the $68^\circ\text{F}$ standard) using a steel gage mastered at $68^\circ\text{F}$.

• Thermal growth of the aluminum part: $\Delta L_{\text{Al}} = 10.0000 \times (12.8 \times 10^{-6}) \times (88 - 68) = 10 \times 0.0000128 \times 20 = +0.00256\text{ in}$
• The aluminum part has expanded by more than two and a half thousandths of an inch simply due to ambient temperature! If the tolerance is $+/- 0.001\text{ in}$, an in-spec part will appear defective unless thermally normalized or mathematically compensated.

---

Angular Units: Degrees, Minutes, Seconds vs Decimal Degrees

Angular dimensions specify orientations, bevels, tapers, and feature locations on bolt circles.

Sexagesimal System (Degrees, Minutes, Seconds)

In traditional shop trigonometry and bevel protractor inspection, angles are subdivided sexagesimally (base-60):

• $1\text{ full circle} = 360^\circ\text{ (degrees)}$
• $1^\circ = 60'\text{ (arcminutes or minutes)}$
• $1' = 60''\text{ (arcseconds or seconds)}$
• Consequently, $1^\circ = 3600''$.

Converting DMS to Decimal Degrees (DD)

$\text{Decimal Degrees} = D + \left(\frac{M}{60}\right) + \left(\frac{S}{3600}\right)$

• Worked Example: An optical dividing head reads an angular index of $42^\circ 27' 36''$. $\text{DD} = 42 + \left(\frac{27}{60}\right) + \left(\frac{36}{3600}\right) = 42 + 0.4500 + 0.0100 = 42.4600^\circ$

Converting Decimal Degrees to DMS

To convert $35.6125^\circ$ to degrees, minutes, and seconds:

1. Whole degrees = $35^\circ$.
2. Multiply fractional part by 60: $0.6125 \times 60 = 36.75'$ (Whole minutes = $36'$).
3. Multiply remaining fractional minute by 60: $0.75 \times 60 = 45''$.
4. Result: $35^\circ 36' 45''$.

Vernier Universal Bevel Protractor

A standard toolmaker's vernier bevel protractor has a main scale graduated in whole degrees and a vernier plate graduated in 5-minute ($5'$) increments from 0 to 60 on both sides. Since $5' = \frac{5}{60}^\circ = \frac{1}{12}^\circ \approx 0.0833^\circ$, the tool provides direct angular resolution of one-twelfth of a degree.

---

Real Shop Inspection Scenarios & Common Exam Traps

• Exam Trap: Approximating 1 Inch as 25 mm: Machinists often use $25\text{ mm}$ as a rough rule of thumb, but doing so on an inspection report introduces an error of $(25.4 - 25.0) / 25.4 \times 100% = 1.57%$. Over a 4-inch part, that error equals $0.063\text{ in}$ ($1.6\text{ mm}$)—vastly exceeding precision machining tolerances! Always use the exact factor $25.4\text{ mm}$.
• Exam Trap: Inverting the Temperature Order of Operations: When converting $^\circ\text{F}$ to $^\circ\text{C}$, the subtractive term must be calculated before multiplying by $5/9$: $C = (F - 32) \times 5/9$. Candidates who calculate $F - (32 \times 5/9)$ subtract $17.78$ instead, creating massive errors.
• Exam Trap: Arcminute as a Decimal Fraction of a Degree: Never write $25^\circ 30'$ as $25.30^\circ$! Because there are 60 minutes in a degree, $30'$ is exactly half a degree ($0.50^\circ$), so $25^\circ 30' = 25.50^\circ$.