3.4 Vector Analysis, Matrices & Probability

3.4 Vector Analysis, Matrices & Probability

Advanced engineering mathematics integrates vector calculus for electromagnetic fields, matrix methods for multi-variable systems, and probability theory for communications and noise analysis. This section provides complete coverage of these three fundamental pillars tested in the PRC ECE Licensure Examination.

---

1. Vector Analysis & Field Operators in ECE

Vector calculus provides the language for Maxwell's equations and electromagnetic wave propagation. A 3D vector in Cartesian coordinates is expressed as $\mathbf{A} = A_x \mathbf{a}_x + A_y \mathbf{a}_y + A_z \mathbf{a}_z$.

1.1 Vector Algebra Foundations

• Dot (Scalar) Product: $\mathbf{A} \cdot \mathbf{B} = A_x B_x + A_y B_y + A_z B_z = |\mathbf{A}| |\mathbf{B}| \cos\theta_{AB}$
• Cross (Vector) Product: Produces a vector perpendicular to both $\mathbf{A}$ and $\mathbf{B}$: $$\mathbf{A} \times \mathbf{B} = (A_y B_z - A_z B_y)\mathbf{a}_x + (A_z B_x - A_x B_z)\mathbf{a}_y + (A_x B_y - A_y B_x)\mathbf{a}_z$$

1.2 The Del Operator and Differential Operators

The vector differential operator Del ($\nabla$) in Cartesian coordinates is:

$$\nabla = \mathbf{a}_x \frac{\partial}{\partial x} + \mathbf{a}_y \frac{\partial}{\partial y} + \mathbf{a}_z \frac{\partial}{\partial z}$$

1. Gradient of a Scalar Field $V$: Vector representing the maximum rate and direction of spatial change:

   $$\nabla V = \frac{\partial V}{\partial x}\mathbf{a}_x + \frac{\partial V}{\partial y}\mathbf{a}_y + \frac{\partial V}{\partial z}\mathbf{a}_z$$

   ECE Application: Electric field vector $\mathbf{E} = -\nabla V$.

2. Divergence of a Vector Field $\mathbf{A}$: Scalar measure of net outward flux per unit volume (source strength):

   $$\nabla \cdot \mathbf{A} = \frac{\partial A_x}{\partial x} + \frac{\partial A_y}{\partial y} + \frac{\partial A_z}{\partial z}$$

   ECE Application: Gauss's Law $\nabla \cdot \mathbf{D} = \rho_v$. If $\nabla \cdot \mathbf{A} = 0$, $\mathbf{A}$ is solenoidal.

3. Curl of a Vector Field $\mathbf{A}$: Vector measure of circulation density:

   $$\nabla \times \mathbf{A} = \left(\frac{\partial A_z}{\partial y} - \frac{\partial A_y}{\partial z}\right)\mathbf{a}_x + \left(\frac{\partial A_x}{\partial z} - \frac{\partial A_z}{\partial x}\right)\mathbf{a}_y + \left(\frac{\partial A_y}{\partial x} - \frac{\partial A_x}{\partial y}\right)\mathbf{a}_z$$

   ECE Application: Ampere's Law $\nabla \times \mathbf{H} = \mathbf{J} + \frac{\partial \mathbf{D}}{\partial t}$. If $\nabla \times \mathbf{A} = \mathbf{0}$, $\mathbf{A}$ is irrotational (conservative).

1.3 Fundamental Integral Theorems

---

2. Matrix Algebra & Linear Systems

Simultaneous linear equations arising from multi-loop mesh and nodal circuit analyses are solved systematically using matrix operations.

2.1 Determinants & Matrix Inversion

For a $2 \times 2$ matrix $A = \begin{bmatrix} a & b \\ c & d \end{bmatrix}$, $\det(A) = ad - bc$. The inverse exists if $\det(A) \ne 0$:

$$A^{-1} = \frac{1}{\det(A)} \begin{bmatrix} d & -b \\ -c & a \end{bmatrix}$$

For an $N \times N$ matrix $A$, the general inverse is given by the adjugate matrix formula:

$$A^{-1} = \frac{1}{\det(A)} \text{adj}(A) = \frac{1}{\det(A)} [C_{ij}]^T$$

Where $C_{ij} = (-1)^{i+j} M_{ij}$ represents the cofactor of element $a_{ij}$.

2.2 Eigenvalues and Eigenvectors

For a square matrix $A$, non-zero vector $\mathbf{x}$ and scalar $\lambda$ satisfying $A \mathbf{x} = \lambda \mathbf{x}$ define eigenvectors and eigenvalues. Eigenvalues are roots of the characteristic polynomial:

$$\det(A - \lambda I) = 0$$

In continuous-time state-space models $\dot{\mathbf{x}} = A \mathbf{x} + B \mathbf{u}$, eigenvalues of state matrix $A$ define natural system modes and stability.

---

3. Probability Theory & Random Variables

Communications engineering relies heavily on probability theory for noise modeling, bit error rate (BER) calculation, and signal detection.

3.1 Conditional Probability & Bayes' Theorem

For two events $A$ and $B$ with $P(B) > 0$, conditional probability is defined as:

$$P(A|B) = \frac{P(A \cap B)}{P(B)}$$

Bayes' Theorem calculates posterior probabilities from prior information:

$$P(A_i|B) = \frac{P(B|A_i) P(A_i)}{\sum_{j=1}^{k} P(B|A_j) P(A_j)}$$

3.2 Discrete Probability Distributions

• Binomial Distribution: Models $k$ successes in $n$ independent Bernoulli trials with success probability $p$: $$P(X = k) = \binom{n}{k} p^k (1 - p)^{n-k}, \quad \mu = n p, \quad \sigma^2 = n p (1 - p)$$
• Poisson Distribution: Models event counts occurring at average rate $\lambda$: $$P(X = k) = \frac{\lambda^k e^{-\lambda}}{k!}, \quad \mu = \lambda, \quad \sigma^2 = \lambda$$

3.3 Continuous Gaussian (Normal) Distribution

The Gaussian Distribution describes Thermal (Additive White Gaussian) Noise in communication channels:

$$f(x) = \frac{1}{\sqrt{2\pi\sigma^2}} \exp\left( -\frac{(x - \mu)^2}{2\sigma^2} \right)$$

Transforming to the Standard Normal Variable $Z$:

$$Z = \frac{X - \mu}{\sigma} \sim \mathcal{N}(0, 1)$$

The tail probability is computed using the Q-Function:

$$Q(x) = \frac{1}{\sqrt{2\pi}} \int_{x}^{\infty} e^{-u^2/2} du$$

In digital communications, Bit Error Rate (BER) for binary signaling is evaluated as $P_e = Q\left(\sqrt{\frac{2 E_b}{N_0}}\right)$.

---

4. PRC ECE Board Exam Worked Examples

Worked Example 1: Vector Field Divergence & Curl Evaluation

Problem: Given vector field $\mathbf{A} = x^2 y \mathbf{a}_x - 2 x z \mathbf{a}_y + 3 y z^2 \mathbf{a}_z$, calculate $\nabla \cdot \mathbf{A}$ at point $P(1, 2, 3)$.

Solution:

1. Compute the divergence partial derivatives: $$\nabla \cdot \mathbf{A} = \frac{\partial}{\partial x}(x^2 y) + \frac{\partial}{\partial y}(-2 x z) + \frac{\partial}{\partial z}(3 y z^2)$$ $$\nabla \cdot \mathbf{A} = 2 x y + 0 + 6 y z = 2 x y + 6 y z$$
2. Substitute point coordinates $(x=1, y=2, z=3)$: $$\nabla \cdot \mathbf{A}\big|_{P} = 2(1)(2) + 6(2)(3) = 4 + 36 = 40$$

Worked Example 2: Bayes' Theorem in Binary Signal Transmission

Problem: A digital transmitter sends bit '0' with probability $0.6$ and bit '1' with probability $0.4$. Noise causes bit errors such that $P(\text{Receive 1}|\text{Sent 0}) = 0.05$ and $P(\text{Receive 0}|\text{Sent 1}) = 0.10$. If bit '1' is received, calculate the probability that bit '1' was actually transmitted.

Solution:

1. Define events: $T_0, T_1$ (transmitted), $R_0, R_1$ (received). Given: $P(T_0) = 0.6$, $P(T_1) = 0.4$, $P(R_1|T_0) = 0.05$, $P(R_1|T_1) = 1 - 0.10 = 0.90$.
2. Calculate total probability of receiving '1': $$P(R_1) = P(R_1|T_1)P(T_1) + P(R_1|T_0)P(T_0)$$ $$P(R_1) = (0.90)(0.4) + (0.05)(0.6) = 0.36 + 0.03 = 0.39$$
3. Apply Bayes' Theorem to find posterior probability $P(T_1|R_1)$: $$P(T_1|R_1) = \frac{P(R_1|T_1)P(T_1)}{P(R_1)} = \frac{0.36}{0.39} = \frac{12}{13} \approx 0.9231 \quad (92.31\%)$$