1.2 Basic Algebra & Technical Formulas

Key Takeaways

  • First-degree single-variable equations in inspection isolate the unknown feature dimension by systematically applying inverse operations to both sides of the equality.
  • In dimensional metrology, deviation equals measured dimension minus nominal dimension (D = M - N), where positive values denote excess material and negative values denote material deficit.
  • For internal features such as bores, Maximum Material Condition (MMC) occurs at the smallest allowable diameter, whereas for external features like shafts, MMC occurs at the largest allowable diameter.
  • Worst-case 1D tolerance stackups determine maximum clearance by subtracting the maximum material shaft from the minimum material hole, maintaining signed algebraic consistency throughout.
  • Taper calculations utilize direct proportions; Taper per Foot (TPF) equals 12 times Taper per Inch (TPI), relating differential diameters directly to gage axial travel.
Last updated: September 2026

1.2 Basic Algebra & Technical Formulas

First-Degree Equations in Dimensional Inspection

Quality inspectors regularly confront technical equations where an unknown dimension, setup height, or deviation must be calculated from known blueprint values and gage readings. A first-degree (linear) algebraic equation involves variables raised only to the first power ($x^1$).

Fundamental Principles of Algebraic Equality

Solving single-variable equations in the shop relies on two foundational axioms:

  1. Addition / Subtraction Property of Equality: The same quantity may be added to or subtracted from both sides of an equation without altering equality: If A+B=C, then A=CB\text{If } A + B = C, \text{ then } A = C - B
  2. Multiplication / Division Property of Equality: Both sides of an equation may be multiplied or divided by the same non-zero quantity: If AB=C, then A=CB(B0)\text{If } A \cdot B = C, \text{ then } A = \frac{C}{B} \quad (B \neq 0)

Shop Application: Step Dimensions and Missing Drawing Features

Engineering drawings occasionally omit an overall reference dimension or an intermediate step length, requiring the inspector to calculate it algebraically before verifying conformance.

  • Problem: A turned shaft has an overall length specified as $L = 6.875\text{ in}$. It contains three stepped diameters: Step 1 is $1.625\text{ in}$, Step 2 is unknown ($x$), and Step 3 is $3.125\text{ in}$.
  • Set up the equation: 1.625+x+3.125=6.8751.625 + x + 3.125 = 6.875 4.750+x=6.8754.750 + x = 6.875 x=6.8754.750=2.125 inx = 6.875 - 4.750 = 2.125\text{ in}

Gage Setup Equation: Depth Micrometer Extension Rods

A mechanical depth micrometer has a thimble/sleeve travel of only $1.000\text{ in}$ (e.g., $0.000$ to $1.000\text{ in}$). To measure deeper cavities, interchangeable extension rods ($1\text{ in}, 2\text{ in}, 3\text{ in}$, etc.) are installed. Total Depth=Extension Rod Length+Thimble Reading\text{Total Depth} = \text{Extension Rod Length} + \text{Thimble Reading}

  • Scenario: An inspector measures a blind keyway using a $3\text{ to } 4\text{ inch}$ extension rod. The thimble reads $0.438\text{ in}$. Depth=3.000+0.438=3.438 in\text{Depth} = 3.000 + 0.438 = 3.438\text{ in}
  • Conversely, if an automated specification mandates a finished bore depth of $4.625\text{ in}$, and a 4-inch rod is used, the expected thimble reading is: Reading=DepthRod=4.6254.000=0.625 in\text{Reading} = \text{Depth} - \text{Rod} = 4.625 - 4.000 = 0.625\text{ in}

Solving for Unknown Inspection Parameters

Dimensional conformance requires translating blueprint nominals and tolerances into Upper Specification Limits (USL) and Lower Specification Limits (LSL), then comparing actual measurements to these limits.

Deviation Formulas

Deviation ($D$) is defined as the signed algebraic difference between the actual measured value ($M$) and the nominal design value ($N$): D=MND = M - N

  • If $M > N$, deviation is positive ($+$), indicating excess material on external parts or an oversize hole.
  • If $M < N$, deviation is negative ($-$), indicating undersize material.
  • Inspector Rule: Always subtract Nominal from Measured: $D = M - N$. Reversing this formula to $N - M$ flips the sign, leading to erroneous tool-offset compensation on CNC machining centers!

Material Condition Limits: MMC and LMC Formulas

In geometric dimensioning and tolerancing (GD&T) and standard inspection, size limits determine the maximum and least material conditions:

  • Maximum Material Condition (MMC): The state of a feature where it contains the maximum amount of material within its stated size limits:
    • External Feature (Shaft / Pin / Boss): $\text{MMC} = \text{USL}$ (Largest allowable external dimension)
    • Internal Feature (Hole / Bore / Slot): $\text{MMC} = \text{LSL}$ (Smallest allowable internal dimension)
  • Least Material Condition (LMC): The state of a feature where it contains the minimum amount of material within its stated size limits:
    • External Feature (Shaft / Pin / Boss): $\text{LMC} = \text{LSL}$ (Smallest allowable external dimension)
    • Internal Feature (Hole / Bore / Slot): $\text{LMC} = \text{USL}$ (Largest allowable internal dimension)
Feature TypeNominal & ToleranceUSLLSLMMC SizeLMC Size
Pin (External)0.750 +/- 0.004 in0.754 in0.746 in0.754 in0.746 in
Bore (Internal)1.500 +0.005 / -0.000 in1.505 in1.500 in1.500 in1.505 in
Slot Width (Internal)0.375 +/- 0.002 in0.377 in0.373 in0.373 in0.377 in

Manipulating Technical Formulas

An inspector must be capable of rearranging technical geometric formulas to solve for unknown variables before taking measurements.

Area and Diameter Relationships

The cross-sectional area of a round tensile test bar or hydraulic piston is given by: A=πd24A = \frac{\pi d^2}{4} To solve for the required diameter ($d$) when given a minimum cross-sectional area:

  1. Multiply both sides by 4: $4A = \pi d^2$
  2. Divide both sides by $\pi$: $\frac{4A}{\pi} = d^2$
  3. Take the square root of both sides: d=4Aπ=2Aπd = \sqrt{\frac{4A}{\pi}} = 2 \sqrt{\frac{A}{\pi}}
  • Inspection Example: A quality plan requires a round tensile test specimen to have a cross-sectional area of at least $0.200\text{ sq in}$. What is the minimum allowable diameter? d=4×0.200π=0.8003.14159=0.25465=0.5046 ind = \sqrt{\frac{4 \times 0.200}{\pi}} = \sqrt{\frac{0.800}{3.14159}} = \sqrt{0.25465} = 0.5046\text{ in}

Gage Block Stackup Formulation

When setting an adjustable snap gage, sine bar, or bore gage comparator, an inspector calculates the required gage block combination: Stack Height=Htarget=b1+b2+b3++bk\text{Stack Height} = H_{\text{target}} = b_1 + b_2 + b_3 + \dots + b_k To minimize measurement uncertainty, the stack must use the minimum number of gage blocks possible (each interface introduces wringing film error of approximately 0.5 to 1 microinch).

  • To find a missing block when a sub-assembly height is predetermined: bneeded=Htargetbexistingb_{\text{needed}} = H_{\text{target}} - \sum b_{\text{existing}}

Working with Signed Numbers in Tolerance Stackups

Signed numbers ($+$ and $-$) are central to tolerance stackup analysis and fit calculations. Errors in handling negative signs lead to catastrophic assembly failures in the field.

Signed Number Rules Summary

  • Adding numbers with the same sign: Add absolute values and keep the common sign ($(-3) + (-5) = -8$).
  • Adding numbers with different signs: Subtract the smaller absolute value from the larger, and keep the sign of the larger ($(+7) + (-10) = -3$).
  • Subtracting signed numbers: Change the sign of the subtrahend and add ($A - (-B) = A + B$).
    • Shop Pitfall: Subtracting a negative lower deviation: If a nominal is $2.000$ and deviation is $-0.004$, the dimension is $2.000 + (-0.004) = 1.996$. If the lower tolerance is $-0.005$, the clearance distance from lower limit is $1.996 - (2.000 - 0.005) = 1.996 - 1.995 = +0.001\text{ in}$.

1D Tolerance Stackup: Hole and Pin Clearance

When evaluating clearance fits between a mating hole and pin: Maximum Clearance=HoleMaxPinMin=HoleLMCPinLMC\text{Maximum Clearance} = \text{Hole}_{\text{Max}} - \text{Pin}_{\text{Min}} = \text{Hole}_{\text{LMC}} - \text{Pin}_{\text{LMC}} Minimum Clearance=HoleMinPinMax=HoleMMCPinMMC\text{Minimum Clearance} = \text{Hole}_{\text{Min}} - \text{Pin}_{\text{Max}} = \text{Hole}_{\text{MMC}} - \text{Pin}_{\text{MMC}}

  • Worked Scenario:
    • Hole: $\varnothing 0.500 +0.004 / -0.000\text{ in}$ ($\text{Min} = 0.500\text{ in}$, $\text{Max} = 0.504\text{ in}$)
    • Pin: $\varnothing 0.498 +0.000 / -0.003\text{ in}$ ($\text{Min} = 0.495\text{ in}$, $\text{Max} = 0.498\text{ in}$)
    • Calculate Maximum Clearance: Max Clearance=0.5040.495=+0.009 in\text{Max Clearance} = 0.504 - 0.495 = +0.009\text{ in}
    • Calculate Minimum Clearance: Min Clearance=0.5000.498=+0.002 in\text{Min Clearance} = 0.500 - 0.498 = +0.002\text{ in}
    • Both values are positive, confirming an all-clearance fit across 100% of the manufacturing tolerance spectrum.

Ratio and Proportion in Shop Setups

Ratios compare two quantities by division ($A : B$ or $A/B$). A proportion states that two ratios are equal: AB=CD    AD=BC\frac{A}{B} = \frac{C}{D} \implies A \cdot D = B \cdot C

Taper Calculations (TPI and TPF)

Tapers represent conical diameter reductions along a given axial length.

  • Taper per Inch (TPI): TPI=DdL\text{TPI} = \frac{D - d}{L} where $D$ is the large diameter, $d$ is the small diameter, and $L$ is the length between measuring planes.
  • Taper per Foot (TPF): TPF=12×TPI=12×(DdL)\text{TPF} = 12 \times \text{TPI} = 12 \times \left(\frac{D - d}{L}\right)
  • Shop Inspection Scenario: An inspector checks a taper shank using two precision measuring rings spaced exactly $3.000\text{ inches}$ apart on a surface plate. The large diameter is $1.231\text{ in}$ and the small diameter is $1.075\text{ in}$. TPI=1.2311.0753.000=0.1563.000=0.052 inches per inch\text{TPI} = \frac{1.231 - 1.075}{3.000} = \frac{0.156}{3.000} = 0.052\text{ inches per inch} TPF=12×0.052=0.624 inches per foot\text{TPF} = 12 \times 0.052 = 0.624\text{ inches per foot}

Optical Comparator Magnification Proportions

Optical comparators project a magnified silhouette of a part onto a ground-glass viewing screen with calibrated crosshairs or radius charts. Magnification (M)=Screen Dimension (Dscreen)Actual Part Dimension (Dactual)\text{Magnification } (M) = \frac{\text{Screen Dimension } (D_{\text{screen}})}{\text{Actual Part Dimension } (D_{\text{actual}})} Actual Part Dimension (Dactual)=DscreenM\text{Actual Part Dimension } (D_{\text{actual}}) = \frac{D_{\text{screen}}}{M}

  • Scenario: Using a $20\times$ magnification lens, an inspector measures a radius overlay on the comparator screen as $1.750\text{ inches}$. Dactual=1.750 in20=0.0875 inD_{\text{actual}} = \frac{1.750\text{ in}}{20} = 0.0875\text{ in}

Real Shop Inspection Scenarios & Common Exam Traps

  • Exam Trap: Inverting the Optical Comparator Ratio: A common exam error is multiplying the screen dimension by the magnification factor instead of dividing. For example, multiplying $1.750 \times 20 = 35.0\text{ inches}$, an absurd dimension for a machined miniature component! Always perform a sanity check: the actual part feature must be smaller than the projected screen image.
  • Exam Trap: Reversing MMC on Internal vs External Features: Inspectors frequently assume MMC is always the larger number. For an external shaft, MMC is indeed the upper limit. But for an internal hole, the MMC is the lower limit because less metal has been cut away, leaving the maximum volume of material in the workpiece.
Test Your Knowledge

An inspector uses an optical comparator equipped with a 50X magnification lens to inspect the profile of a precision thread-cutting insert. On the comparator screen, the tip flat width measures 0.625 inches. What is the actual width of the insert tip flat?

A
B
C
D
Test Your Knowledge

A mating assembly consists of a bushing bore specified as 1.750 (+0.003 / -0.000) inches and a mating pin specified as 1.748 (+0.000 / -0.002) inches. What is the maximum possible clearance between the bore and the pin under worst-case tolerance stackup conditions?

A
B
C
D
Test Your Knowledge

An engineering drawing shows a total stepped shaft length of 5.500 inches. The blueprint details three sequential sections: Section A = 1.875 inches, Section B = x (unspecified), and Section C = 2.375 inches. What is the required length of Section B?

A
B
C
D