PracticeVideosBlogFlashcards

1.4 Linear Algebra, Matrices, and Systems of Equations

Key Takeaways

  • Matrix multiplication is associative (AB)C=A(BC)(AB)C = A(BC) but generally non-commutative (AB≠BAAB \neq BA).

  • A square matrix AA is invertible if and only if its determinant det⁡(A)≠0\det(A) \neq 0 (non-singular).

  • Cramer's Rule solves linear systems Ax=bA\mathbf{x} = \mathbf{b} using ratios of determinants xi=det⁡(Ai)/det⁡(A)x_i = \det(A_i)/\det(A).

  • Eigenvalues λ\lambda satisfy the characteristic equation det⁡(A−λI)=0\det(A - \lambda I) = 0, representing principal stretch factors or natural frequencies in engineering systems.

  • System consistency depends on matrix rank: rank(A)=rank([A∣b])=n\text{rank}(A) = \text{rank}([A|b]) = n guarantees a unique solution.

Last updated: August 2026

1.4 Linear Algebra, Matrices, and Systems of Equations

Linear algebra provides the mathematical framework for solving large-scale structural truss systems, electrical circuit networks, finite element analysis (FEA), state-space control systems, and principal stress transformations on the FE exam.


1. Matrix Operations & Properties

Matrix Definition & Order

An m×nm \times n matrix AA consists of mm rows and nn columns. The element in row ii and column jj is denoted aija_{ij}.

Fundamental Operations

  • Scalar Multiplication: kA=[kaij]k A = [k a_{ij}]

  • Matrix Addition: For AA and BB of identical size m×nm \times n, C=A+B  ⟹  cij=aij+bijC = A + B \implies c_{ij} = a_{ij} + b_{ij}.

  • Matrix Multiplication: For AA (m×pm \times p) and BB (p×np \times n), the product C=ABC = AB (m×nm \times n) has elements:

    cij=∑k=1paikbkjc_{ij} = \sum_{k=1}^{p} a_{ik} b_{kj}

    Note: Matrix multiplication is non-commutative (AB≠BAAB \neq BA in general).

  • Transpose of a Matrix (ATA^T): Formed by swapping rows and columns (aijT=ajia_{ij}^T = a_{ji}).

    • (A+B)T=AT+BT(A + B)^T = A^T + B^T
    • (AB)T=BTAT(AB)^T = B^T A^T
    • A matrix is symmetric if AT=AA^T = A, and skew-symmetric if AT=−AA^T = -A.
  • Trace of a Square Matrix: Sum of diagonal elements tr(A)=∑i=1naii\text{tr}(A) = \sum_{i=1}^n a_{ii}.


2. Determinants & Matrix Inverses

Determinants

Determinants exist only for square (n×nn \times n) matrices.

  • 2×22 \times 2 Matrix:

    det⁡[ab cd]=ad−bc\det \begin{bmatrix} a & b \\\ c & d \end{bmatrix} = ad - bc
  • 3×33 \times 3 Matrix (Cofactor Expansion along Row 1):

    det⁡[a11a12a13 a21a22a23 a31a32a33]=a11(a22a33−a23a32)−a12(a21a33−a23a31)+a13(a21a32−a22a31)\det \begin{bmatrix} a_{11} & a_{12} & a_{13} \\\ a_{21} & a_{22} & a_{23} \\\ a_{31} & a_{32} & a_{33} \end{bmatrix} = a_{11}(a_{22}a_{33} - a_{23}a_{32}) - a_{12}(a_{21}a_{33} - a_{23}a_{31}) + a_{13}(a_{21}a_{32} - a_{22}a_{31})

Key Determinant Rules

  1. det⁡(AB)=det⁡(A)⋅det⁡(B)\det(AB) = \det(A) \cdot \det(B)
  2. det⁡(AT)=det⁡(A)\det(A^T) = \det(A)
  3. det⁡(A−1)=1det⁡(A)\det(A^{-1}) = \frac{1}{\det(A)}
  4. det⁡(kA)=kndet⁡(A)\det(kA) = k^n \det(A) for an n×nn \times n matrix.
  5. Swapping two rows/columns changes the sign of the determinant.
  6. If a row or column is all zeros, or if two rows are identical/proportional, det⁡(A)=0\det(A) = 0.

Inverse Matrix (A−1A^{-1})

A square matrix AA has an inverse A−1A^{-1} such that AA−1=A−1A=IA A^{-1} = A^{-1} A = I if and only if det⁡(A)≠0\det(A) \neq 0 (AA is non-singular).

  • 2×22 \times 2 Matrix Inverse Formula:

    A−1=1ad−bc[d−b −ca]A^{-1} = \frac{1}{ad - bc} \begin{bmatrix} d & -b \\\ -c & a \end{bmatrix}
  • General Adjugate Formula:

    A−1=1det⁡(A)adj(A)=1det⁡(A)[Cij]TA^{-1} = \frac{1}{\det(A)} \text{adj}(A) = \frac{1}{\det(A)} [C_{ij}]^T

    where Cij=(−1)i+jMijC_{ij} = (-1)^{i+j} M_{ij} is the cofactor matrix.


3. Systems of Linear Equations & Cramer's Rule

A system of nn linear equations in nn unknowns can be written in matrix form Ax=bA\mathbf{x} = \mathbf{b}:

[a11a12⋯a1n a21a22⋯a2n ⋮⋮⋱⋮ an1an2⋯ann][x1 x2 ⋮ xn]=[b1 b2 ⋮ bn]\begin{bmatrix} a_{11} & a_{12} & \cdots & a_{1n} \\\ a_{21} & a_{22} & \cdots & a_{2n} \\\ \vdots & \vdots & \ddots & \vdots \\\ a_{n1} & a_{n2} & \cdots & a_{nn} \end{bmatrix} \begin{bmatrix} x_1 \\\ x_2 \\\ \vdots \\\ x_n \end{bmatrix} = \begin{bmatrix} b_1 \\\ b_2 \\\ \vdots \\\ b_n \end{bmatrix}

Existence & Uniqueness Criteria

  • Unique Solution: rank(A)=rank([A∣b])=n  ⟺  det⁡(A)≠0\text{rank}(A) = \text{rank}([A|\mathbf{b}]) = n \iff \det(A) \neq 0.
  • Infinitely Many Solutions: rank(A)=rank([A∣b])<n\text{rank}(A) = \text{rank}([A|\mathbf{b}]) < n.
  • No Solution (Inconsistent System): rank(A)<rank([A∣b])\text{rank}(A) < \text{rank}([A|\mathbf{b}]).

Cramer's Rule

If det⁡(A)≠0\det(A) \neq 0, the unique solution for variable xix_i is:

xi=det⁡(Ai)det⁡(A)x_i = \frac{\det(A_i)}{\det(A)}

where AiA_i is the matrix formed by replacing column ii of AA with column vector b\mathbf{b}.


4. Eigenvalues and Eigenvectors

For a square n×nn \times n matrix AA, a scalar λ\lambda and non-zero vector v\mathbf{v} are an eigenvalue and eigenvector if:

Av=λv  ⟹  (A−λI)v=0A \mathbf{v} = \lambda \mathbf{v} \implies (A - \lambda I)\mathbf{v} = \mathbf{0}

Characteristic Equation

For a non-trivial vector v≠0\mathbf{v} \neq \mathbf{0} to exist, the matrix (A−λI)(A - \lambda I) must be singular:

det⁡(A−λI)=0\det(A - \lambda I) = 0

Evaluating this determinant yields the nn-th degree characteristic polynomial in λ\lambda. Roots of this polynomial are the eigenvalues λi\lambda_i.

Physical Significance in Engineering

  • Solid Mechanics: Eigenvalues of the 2D/3D stress tensor represent principal stresses (σ1,σ2,σ3\sigma_1, \sigma_2, \sigma_3), and eigenvectors indicate principal stress orientations.
  • Vibrations & Dynamics: Eigenvalues represent squared natural frequencies (ω2\omega^2), and eigenvectors represent mode shapes.

5. Worked Engineering Problems

Worked Example 1: Solving Electrical Mesh System via Cramer's Rule

Problem: Solve for mesh current I2I_2 in the 3-mesh circuit system:

[5−20 −28−3 0−36][I1 I2 I3]=[12 0 0]\begin{bmatrix} 5 & -2 & 0 \\\ -2 & 8 & -3 \\\ 0 & -3 & 6 \end{bmatrix} \begin{bmatrix} I_1 \\\ I_2 \\\ I_3 \end{bmatrix} = \begin{bmatrix} 12 \\\ 0 \\\ 0 \end{bmatrix}

Solution:

Step 1: Compute determinant of coefficient matrix det⁡(A)\det(A).

det⁡(A)=5[(8)(6)−(−3)(−3)]−(−2)[(−2)(6)−(−3)(0)]+0\det(A) = 5[(8)(6) - (-3)(-3)] - (-2)[(-2)(6) - (-3)(0)] + 0 det⁡(A)=5[48−9]+2[−12−0]=5(39)−24=195−24=171\det(A) = 5[48 - 9] + 2[-12 - 0] = 5(39) - 24 = 195 - 24 = 171

Step 2: Form matrix A2A_2 by replacing Column 2 with vector b\mathbf{b}.

A2=[5120 −20−3 006]A_2 = \begin{bmatrix} 5 & 12 & 0 \\\ -2 & 0 & -3 \\\ 0 & 0 & 6 \end{bmatrix}

Step 3: Compute det⁡(A2)\det(A_2) by expanding along Row 3 or Column 2. Expanding along Column 2:

det⁡(A2)=−12∣−2−3 06∣=−12[(−2)(6)−(0)]=−12(−12)=144\det(A_2) = -12 \begin{vmatrix} -2 & -3 \\\ 0 & 6 \end{vmatrix} = -12 [(-2)(6) - (0)] = -12(-12) = 144

Step 4: Compute I2I_2.

I2=det⁡(A2)det⁡(A)=144171=1619≈0.8421 AI_2 = \frac{\det(A_2)}{\det(A)} = \frac{144}{171} = \frac{16}{19} \approx 0.8421\text{ A}

Worked Example 2: Principal Stresses via Eigenvalue Analysis

Problem: A state of plane stress is represented by matrix A=[4020 2010] MPaA = \begin{bmatrix} 40 & 20 \\\ 20 & 10 \end{bmatrix}\text{ MPa}. Find the eigenvalues λ1,λ2\lambda_1, \lambda_2 (principal stresses) of matrix AA.

Solution:

Step 1: Set up characteristic equation det⁡(A−λI)=0\det(A - \lambda I) = 0.

det⁡[40−λ20 2010−λ]=(40−λ)(10−λ)−(20)(20)=0\det \begin{bmatrix} 40 - \lambda & 20 \\\ 20 & 10 - \lambda \end{bmatrix} = (40 - \lambda)(10 - \lambda) - (20)(20) = 0 λ2−50λ+400−400=0\lambda^2 - 50\lambda + 400 - 400 = 0 λ2−50λ=0\lambda^2 - 50\lambda = 0

Step 2: Solve for roots λ\lambda.

λ(λ−50)=0\lambda(\lambda - 50) = 0 λ1=50 MPa,λ2=0 MPa\lambda_1 = 50\text{ MPa}, \quad \lambda_2 = 0\text{ MPa}

Thus, the principal stresses are σ1=50 MPa\sigma_1 = 50\text{ MPa} and σ2=0 MPa\sigma_2 = 0\text{ MPa}.

Loading diagram...
Matrix System Solvability and Determinant Classification
Test Your Knowledge

What is the determinant of the 3x3 matrix A = [[2, 1, 3], [0, 4, -1], [1, 2, 0]]?

A

5

B

-3

C

-9

D

12

Test Your Knowledge

Compute the inverse of the 2x2 matrix A = [[4, 2], [3, 2]].

A

[[1.0, -1.0], [-1.5, 2.0]]

B

[[2.0, -1.0], [-1.5, 2.0]]

C

[[-1.0, 1.0], [1.5, -2.0]]

D

[[0.5, -0.5], [-0.75, 1.0]]

Test Your Knowledge

Determine the eigenvalues of the matrix A = [[5, 2], [2, 2]].

A

lambda1 = 4, lambda2 = 3

B

lambda1 = 7, lambda2 = 0

C

lambda1 = 5, lambda2 = 2

D

lambda1 = 6, lambda2 = 1

Test Your Knowledge

Apply Cramer's Rule to find y for the system of equations: 2x + y = 7 and x + 3y = 11.

A

y = 2

B

y = 3

C

y = 4

D

y = 5

Sections you finish are checked off in the contents.