2.2 Calculus: Differential, Integral, and Series Approximations

Calculus is the mathematical foundation of continuous modeling in industrial and systems engineering. From determining the optimal production lot size that minimizes inventory carrying and setup costs, to computing the mean time between failures (MTBF) of automated machinery, mastery of differential, integral, and series calculus is critical for passing the NCEES FE Industrial examination.

---

1. Differential Calculus: Operational Rules and Partial Derivatives

Fundamental Derivative Rules

The derivative represents the instantaneous rate of change of a physical or economic function, defined formally as:

$f'(x) = \lim_{\Delta x \to 0} \frac{f(x + \Delta x) - f(x)}{\Delta x}$

On the FE exam, efficiency requires instant recall and application of operational rules:

1. Product Rule: $\frac{d}{dx}[u \cdot v] = u' v + u v'$
2. Quotient Rule: $\frac{d}{dx}\left[\frac{u}{v}\right] = \frac{u' v - u v'}{v^2}$ (mnemonic: "low d-high minus high d-low over the square of what's below")
3. Chain Rule: $\frac{d}{dx}[f(g(x))] = f'(g(x)) \cdot g'(x)$
4. Exponential Rules: $\frac{d}{dx}[e^{kx}] = k e^{kx}, \quad \frac{d}{dx}[a^u] = a^u (\ln a) \frac{du}{dx}$
5. Logarithmic Rules: $\frac{d}{dx}[\ln(x)] = \frac{1}{x}, \quad \frac{d}{dx}[\ln(u)] = \frac{u'}{u}, \quad \frac{d}{dx}[\log_a(u)] = \frac{u'}{u \ln a}$

Partial Derivatives and the Gradient Vector

Industrial systems generally involve multivariable functions, such as production throughput as a function of labor and capital, or total distribution cost as a function of multiple warehouse coordinates. When evaluating the partial derivative $\frac{\partial f}{\partial x}$, all other variables ($y, z, \dots$) are treated strictly as constants.

• Clairaut's Theorem (Mixed Partials): If $f(x, y)$ and its partial derivatives are continuous on an open region, the mixed second partial derivatives are identical: $\frac{\partial^2 f}{\partial x \partial y} = \frac{\partial^2 f}{\partial y \partial x} \quad (f_{xy} = f_{yx})$

• Gradient Vector ($\nabla f$): The vector of first-order partial derivatives: $\nabla f(x, y) = \begin{bmatrix} \frac{\partial f}{\partial x} \\ \frac{\partial f}{\partial y} \end{bmatrix}$ The gradient vector points in the direction of greatest instantaneous increase of $f$, and its Euclidean magnitude $|\nabla f|$ represents the maximum directional derivative.

---

2. Univariate and Multivariate Optimization in Engineering Systems

Optimization is central to industrial engineering. We seek input conditions that minimize undesirable outcomes (cost, defect rates, transit delays) or maximize desirable outcomes (profit, throughput, system reliability).

Univariate Optimization

To optimize a single-variable differentiable function $f(x)$ over an open interval:

1. Find Critical Points: Solve $f'(x) = 0$ or identify points where $f'(x)$ fails to exist.
2. Second Derivative Test:
   • If $f''(x^) > 0$: The function is concave upward (convex); $x^$ is a local minimum.
   • If $f''(x^) < 0$: The function is concave downward (concave); $x^$ is a local maximum.
   • If $f''(x^*) = 0$: The test is inconclusive (the point may be an inflection point, local max, or local min; analyze sign changes in $f'(x)$).
3. Global Extrema on a Closed Interval $[a, b]$: Evaluate $f(x)$ at all interior critical points and compare them directly against boundary values $f(a)$ and $f(b)$.

Multivariate Unconstrained Optimization and the Hessian Matrix

For a two-variable function $f(x, y)$:

1. Stationary Points: Solve the simultaneous system of first partial derivatives: $\nabla f(x, y) = \mathbf{0} \quad \implies \quad f_x(x, y) = 0 \quad \text{and} \quad f_y(x, y) = 0$
2. Construct the Hessian Matrix ($H$): $H = \begin{bmatrix} f_{xx} & f_{xy} \\ f_{yx} & f_{yy} \end{bmatrix}$
3. Compute the Hessian Determinant ($D$): $D = \det(H) = f_{xx} f_{yy} - (f_{xy})^2$
4. Second Partial Derivative Test Classification:

Hessian Determinant: D = f_xx * f_yy - (f_xy)^2
 ├── D > 0
 │    ├── f_xx > 0 ──> Local Minimum (e.g., minimum cost surface)
 │    └── f_xx < 0 ──> Local Maximum (e.g., maximum profit surface)
 ├── D < 0 ──────────> Saddle Point (neither min nor max)
 └── D = 0 ──────────> Inconclusive

---

3. Integral Calculus: Analytical Methods and Physical Applications

Fundamental Theorem of Calculus

If $f(x)$ is continuous on $[a, b]$ and $F'(x) = f(x)$, then:

$\int_a^b f(x) \, dx = F(b) - F(a)$

Integration by Substitution ($u$-Substitution)

Reverses the chain rule by mapping an integrand into a simpler variable form:

$\int f(g(x)) g'(x) \, dx = \int f(u) \, du, \quad \text{where } u = g(x), \, du = g'(x) dx$

Integration by Parts

Reverses the product rule, essential when the integrand contains products of algebraic, exponential, or logarithmic terms:

$\int u \, dv = u v - \int v \, du$

Selection Strategy (LIATE Rule): Choose $u$ in order of priority: Logarithmic, Inverse trigonometric, Algebraic, Trigonometric, Exponential. The remaining factor becomes $dv$.

Mean Value Theorem for Integrals

The average value of a continuous engineering process variable $f(x)$ over an operational interval $[a, b]$ is:

$f_{\text{avg}} = \frac{1}{b - a} \int_a^b f(x) \, dx$

Applications: Calculating the average power load on a transformer bank over an 8-hour shift, or the time-weighted average work-in-process (WIP) level in an inventory staging buffer.

Continuous Probability and System Reliability

Industrial engineers frequently evaluate continuous random variables governed by a probability density function (PDF) $f(t)$ for $t \ge 0$:

• Total Probability Condition: $\int_{-\infty}^{\infty} f(t) , dt = 1$
• Cumulative Distribution Function (CDF): $F(t) = P(T \le t) = \int_{-\infty}^t f(\tau) , d\tau$
• Reliability Function: $R(t) = P(T > t) = 1 - F(t) = \int_t^{\infty} f(\tau) , d\tau$
• Expected Lifetime (Mean Time To Failure - MTTF): $\text{MTTF} = E[T] = \int_0^{\infty} t f(t) \, dt = \int_0^{\infty} R(t) \, dt$

---

4. Infinite Series, Taylor Expansions, and Convergence

Taylor and Maclaurin Series

A Taylor series represents an infinitely differentiable function $f(x)$ near a base point $x = a$:

$f(x) = \sum_{n=0}^{\infty} \frac{f^{(n)}(a)}{n!} (x - a)^n = f(a) + f'(a)(x - a) + \frac{f''(a)}{2!}(x - a)^2 + \frac{f'''(a)}{3!}(x - a)^3 + \dots$

When $a = 0$, the expansion is known specifically as a Maclaurin Series:

$f(x) = \sum_{n=0}^{\infty} \frac{f^{(n)}(0)}{n!} x^n = f(0) + f'(0)x + \frac{f''(0)}{2!}x^2 + \dots$

Standard Maclaurin Expansions in Engineering

Convergence Tests

To determine whether an infinite series $\sum a_n$ converges:

• Ratio Test: Compute $L = \lim_{n \to \infty} \left| \frac{a_{n+1}}{a_n} \right|$.
  • If $L < 1$: Series converges absolutely.
  • If $L > 1$: Series diverges.
  • If $L = 1$: Test is inconclusive.
• Geometric Series Test: The series $\sum_{n=0}^{\infty} a r^n$ converges to $S = \frac{a}{1 - r}$ if and only if $|r| < 1$. If $|r| \ge 1$, the series diverges.

---

5. Step-by-Step Worked Engineering Examples

Worked Example 2.2.1: Mathematical Derivation of the EOQ Lot Size

Problem: In production inventory theory, an industrial facility faces constant annual demand $D = 10{,}000\text{ units/year}$, order/setup cost $S = $7.20\text{ per order}$, and annual unit holding cost $H = $10\text{ per unit/year}$. Total annual cost as a function of order lot size $Q$ is modeled by:

$TC(Q) = 250{,}000 + \frac{D S}{Q} + \frac{H Q}{2} = 250{,}000 + \frac{72{,}000}{Q} + 5Q$

Using calculus, determine the lot size $Q^*$ that minimizes total annual cost, verify that the second derivative confirms a local minimum, and compute the minimum variable cost.

Solution:

1. Confirm the coefficients: $DS = (10{,}000)(7.20) = 72{,}000$ and $H/2 = 10/2 = 5$, matching the stated cost function.
2. Differentiate $TC(Q)$ with respect to $Q$ and set the derivative to zero: $\frac{dTC}{dQ} = -\frac{D S}{Q^2} + \frac{H}{2} = -\frac{72{,}000}{Q^2} + 5 = 0 \quad \implies \quad 5 = \frac{72{,}000}{Q^2}$ $Q^2 = \frac{72{,}000}{5} = 14{,}400 \quad \implies \quad Q^* = \sqrt{14{,}400} = 120\text{ units}$ (Cross-check against the closed-form EOQ formula: $Q^ = \sqrt{2DS/H} = \sqrt{2(10{,}000)(7.20)/10} = \sqrt{14{,}400} = 120$ units.)*
3. Execute the Second Derivative Test: $\frac{d^2TC}{dQ^2} = \frac{d}{dQ}\left[ -72{,}000 Q^{-2} + 5 \right] = 2(72{,}000) Q^{-3} = \frac{144{,}000}{Q^3}$
4. Evaluate at $Q^* = 120$: $\frac{d^2TC}{dQ^2}\bigg|_{Q=120} = \frac{144{,}000}{(120)^3} = \frac{144{,}000}{1{,}728{,}000} = +0.0833 > 0$
5. Conclusion: Because the second derivative is strictly positive, the cost curve is convex (concave upward), proving that $Q^* = 120\text{ units}$ represents a strict local and global minimum.

Worked Example 2.2.2: Component MTTF via Integration by Parts

Problem: An industrial robotic arm actuator has a failure probability density function $f(t) = 0.04 t e^{-0.2 t}$ for $t \ge 0$ (operating hours in thousands). Compute the mean time to failure $\text{MTTF} = \int_0^\infty t f(t) dt$.

Solution:

1. Set up the expected value integral: $\text{MTTF} = \int_0^\infty t (0.04 t e^{-0.2 t}) \, dt = 0.04 \int_0^\infty t^2 e^{-0.2 t} \, dt$
2. Recall the general gamma-type integral $\int_0^\infty t^n e^{-k t} dt = \frac{n!}{k^{n+1}}$ for $k > 0$: Here $n = 2$ and $k = 0.2 = 1/5$: $\int_0^\infty t^2 e^{-0.2 t} \, dt = \frac{2!}{(0.2)^{2+1}} = \frac{2}{(0.2)^3} = \frac{2}{0.008} = 250$
3. Multiply by the constant scalar $0.04$: $\text{MTTF} = 0.04 \times 250 = 10\text{ (thousand hours)} = 10{,}000\text{ operating hours}$

---

6. NCEES Reference Handbook Tips & Realistic Exam Traps

• Quotient Rule Sign Error: The most common differentiation mistake on the FE exam is inverting the numerator of the quotient rule: $\frac{u v' - u' v}{v^2}$ instead of the correct $\frac{u' v - u v'}{v^2}$. This flips the sign of the derivative, which falsely converts a calculated minimum into a maximum.
• Saddle Points vs. Inconclusive Tests: If $D = f_{xx} f_{yy} - (f_{xy})^2 < 0$, the stationary point is definitively a saddle point. Do NOT confuse this with $D = 0$ (which is the only condition where the test is inconclusive). A saddle point means the function increases along one path and decreases along another.
• Boundary Points in Optimization: If an exam problem specifies operational constraints—such as machine capacity $0 \le x \le 50$—always verify whether the global optimum lies on the boundary rather than an unconstrained interior critical point.
• Integration by Parts Signs: In $\int u , dv = u v - \int v , du$, when $v$ contains a negative sign (such as $v = -\frac{1}{k} e^{-kt}$), subtracting a negative creates an addition: $u v - \int (-\text{term}) du = u v + \int \text{term} , du$. Missing this double negative is an intentional distractor trap on FE exam questions.