7.1 Fundamental Probability Concepts

Foundations of Probability: Terminology & Definitions

Probability is the mathematical branch that measures the likelihood that a particular event will occur. In quantitative reasoning, probability provides a standardized numerical scale to evaluate uncertainty, quantify risk, and analyze random phenomena.

To master probability on the ACCUPLACER Quantitative Reasoning, Algebra, and Statistics (QAS) test, you must understand four core foundational terms:

1. Experiment (or Trial): Any repeatable process or observation that yields an uncertain outcome (e.g., flipping a fair coin, rolling a six-sided die, or selecting a manufactured component from an assembly line).
2. Outcome: A single specific result produced by a single execution of an experiment (e.g., rolling a $4$, or drawing an Ace of Spades).
3. Sample Space ($S$): The exhaustive set containing all possible outcomes of an experiment. The total number of distinct outcomes in the sample space is denoted as $n(S)$ or $|S|$.
   • Example (Single Coin Flip): $S = \{\text{Heads}, \text{Tails}\}$, where $n(S) = 2$.
   • Example (Standard Six-Sided Die): $S = \{1, 2, 3, 4, 5, 6\}$, where $n(S) = 6$.
4. Event ($E$): Any subset of the sample space ($E \subseteq S$). An event may consist of a single outcome (simple event) or multiple outcomes (compound event).
   • Example: Rolling an even number on a standard die corresponds to the event $E = \{2, 4, 6\}$, with $n(E) = 3$.

---

The Classical Probability Formula & The Probability Scale

When all individual outcomes in a finite sample space $S$ are equally likely, the theoretical probability of an event $E$ is given by the fundamental ratio:

$P(E) = \frac{\text{Number of Favorable Outcomes}}{\text{Total Number of Possible Outcomes}} = \frac{n(E)}{n(S)}$

The Bounded Probability Scale

Every valid probability value is strictly bounded on the closed numerical interval between $0$ and $1$, inclusive:

$0 \le P(E) \le 1 \quad \iff \quad 0\% \le P(E) \le 100\%$

0.0 (0%)                 0.25 (25%)              0.50 (50%)              0.75 (75%)                 1.0 (100%)
   ├────────────────────────┼───────────────────────┼───────────────────────┼────────────────────────┤
Impossible               Unlikely             Equally Likely             Likely                   Certain
  Event                                        (Even Chance)                                       Event
 P(E) = 0                                       P(E) = 1/2                                        P(E) = 1

• Impossible Event ($P(E) = 0$): The event cannot occur under any circumstances (e.g., rolling an $8$ on a standard six-sided die).
• Certain Event ($P(E) = 1$): The event is guaranteed to occur on every trial (e.g., rolling a positive integer less than $7$ on a standard die).
• Sum of All Probabilities: The sum of the probabilities of all mutually exclusive elementary outcomes in a sample space always equals exactly $1$: $\sum_{i=1}^{k} P(O_i) = 1$

---

Theoretical vs. Experimental (Empirical) Probability

Probability problems on the ACCUPLACER exam distinguish between two distinct methods of evaluating likelihood:

| Feature | Theoretical Probability | Experimental (Empirical) Probability | | :--- | :--- | :--- | :--- | | Definition | Likelihood based on mathematical analysis of ideal, equally likely outcomes. | Likelihood based on actual observed relative frequencies from real-world trials. | | Formula | $P(E) = \frac{n(E)}{n(S)}$ | $P_{\text{exp}}(E) = \frac{\text{Number of Times } E \text{ Occurred}}{\text{Total Number of Trials Executed}} = \frac{f}{N}$ | | Data Source | Abstract structure and geometric symmetry. | Historical data, laboratory experiments, quality control tests. | | Example | A fair coin has $P(\text{Heads}) = \frac{1}{2} = 0.50$. | Flipping a coin $100$ times and observing $54$ heads gives $P_{\text{exp}}(\text{Heads}) = \frac{54}{100} = 0.54$. |

The Law of Large Numbers (LLN)

The Law of Large Numbers states that as the number of repetitions or trials ($N$) of an experiment increases indefinitely ($N \to \infty$), the experimental relative frequency $\frac{f}{N}$ converges toward the true theoretical probability $P(E)$:

$\lim_{N \to \infty} P_{\text{exp}}(E) = P(E)$

Exam Context: Small sample sizes (e.g., $10$ flips) may show substantial deviation from theoretical probability due to random fluctuation, but large sample sizes (e.g., $10,000$ flips) will mirror theoretical predictions with high precision.

---

The Fundamental Counting Principle

Before computing probabilities for complex compound experiments, you must be able to determine the total size of the sample space $n(S)$. The Fundamental Counting Principle (Multiplication Principle of Counting) provides the algebraic foundation:

$\text{If a process consists of } k \text{ successive stages where Stage 1 has } n_1 \text{ possible outcomes, Stage 2 has } n_2 \text{ outcomes, } \dots, \text{ and Stage } k \text{ has } n_k \text{ outcomes:}$ $\text{Total Outcomes } n(S) = n_1 \times n_2 \times n_3 \times \dots \times n_k$

Applications of the Counting Principle

1. Multiple Coin Tosses: Tossing $4$ fair coins produces $2 \times 2 \times 2 \times 2 = 2^4 = 16$ possible outcomes.
2. Rolling Two Standard Dice: Rolling two distinct dice produces $6 \times 6 = 36$ ordered pairs: $S = \{(1,1), (1,2), \dots, (6,5), (6,6)\}$
3. System Access Codes: A $4$-digit PIN where the first digit cannot be zero ($9$ choices: $1$–$9$) and digits may repeat ($10$ choices each for remaining positions) yields: $\text{Total PINs} = 9 \times 10 \times 10 \times 10 = 9,000\text{ unique PINs}$

---

The Complement Rule & "At Least One" Probabilities

The complement of an event $E$, denoted by $E'$ (or $E^c$, or $\bar{E}$, or "not $E$"), consists of all outcomes in the sample space $S$ that are not in $E$.

$\text{Since } E \text{ and } E' \text{ partition the sample space } S: \quad P(E) + P(E') = 1$

The Complement Rule Formula

$P(E') = 1 - P(E) \quad \iff \quad P(E) = 1 - P(E')$

The Power of the Complement: The "At Least One" Shortcut

Calculating the probability of obtaining "at least one" success across multiple trials by direct addition requires summing many separate compound probabilities ($P(1) + P(2) + P(3) + \dots$). The complement of "at least one success" is simply "zero successes" (none).

$P(\text{at least one success}) = 1 - P(\text{zero successes}) = 1 - P(\text{none})$

Example: A fair six-sided die is rolled $3$ times. What is the probability of rolling at least one $6$?

• Probability of NOT rolling a $6$ on a single roll: $P(\text{no } 6) = \frac{5}{6}$.
• Probability of rolling NO sixes on all $3$ independent rolls: $P(\text{no } 6\text{ in } 3\text{ rolls}) = \left(\frac{5}{6}\right)^3 = \frac{125}{216}$
• Probability of at least one $6$: $P(\text{at least one } 6) = 1 - \frac{125}{216} = \frac{216 - 125}{216} = \frac{91}{216} \approx 0.4213\text{ (or } 42.13\%\text{)}$

---

Compound Probability: The Multiplication Rules ("AND")

A compound event combines two or more simple events. When computing the joint probability that event $A$ AND event $B$ both occur ($P(A \cap B)$ or $P(A \text{ and } B)$), the mathematical procedure depends on whether the events are independent or dependent.

                           Compound Event: P(A and B)
                                       │
                     Are the events independent or dependent?
                                       │
                ┌──────────────────────┴──────────────────────┐
                ▼                                             ▼
       Independent Events                             Dependent Events
   P(B|A) = P(B) (No effect)                    P(B|A) ≠ P(B) (Outcome changes)
   P(A and B) = P(A) · P(B)                      P(A and B) = P(A) · P(B|A)
   (Coin flips, replacement)                    (Sampling WITHOUT replacement)

1. Independent Events

Two events $A$ and $B$ are independent if the occurrence of event $A$ does not alter the probability of event $B$ occurring: $P(B \mid A) = P(B)$

Multiplication Rule for Independent Events: $P(A \text{ and } B) = P(A) \cdot P(B)$

• Examples of Independent Events:
  • Flipping a coin and rolling a die.
  • Selecting a marble from an urn, replacing it, and drawing a second marble.
  • Weather in Tokyo and stock prices in New York.

2. Dependent Events & Conditional Probability Intuition

Two events $A$ and $B$ are dependent if the occurrence of event $A$ affects the likelihood of event $B$. The conditional probability $P(B \mid A)$ represents the probability of event $B$ occurring given that event $A$ has already occurred.

General Multiplication Rule (Dependent Events): $P(A \text{ and } B) = P(A) \cdot P(B \mid A)$

• The Classic Dependent Model: Sampling Without Replacement: When objects are drawn sequentially from a finite population without being returned, each draw changes both the numerator (remaining favorable items) and the denominator (total remaining items) for subsequent draws.

---

Compound Probability: The Addition Rules ("OR")

When calculating the probability that event $A$ OR event $B$ (or both) occurs ($P(A \cup B)$ or $P(A \text{ or } B)$), the procedure depends on whether the events can occur simultaneously.

                           Compound Event: P(A or B)
                                       │
                     Can both events occur simultaneously?
                                       │
                ┌──────────────────────┴──────────────────────┐
                ▼                                             ▼
    Mutually Exclusive (Disjoint)                    Overlapping (Non-Disjoint)
      A ∩ B = ∅ (Cannot overlap)                   A ∩ B ≠ ∅ (Shared outcomes exist)
        P(A and B) = 0                               P(A and B) > 0
      P(A or B) = P(A) + P(B)                   P(A or B) = P(A) + P(B) - P(A and B)

1. Mutually Exclusive (Disjoint) Events

Two events are mutually exclusive (or disjoint) if they have no outcomes in common and cannot happen at the same time ($A \cap B = \emptyset$, so $P(A \text{ and } B) = 0$).

Addition Rule for Mutually Exclusive Events: $P(A \text{ or } B) = P(A) + P(B)$

• Example: Drawing a single card from a standard $52$-card deck. Event $A = \text{Ace}$, Event $B = \text{King}$. A card cannot be both an Ace and a King. $P(\text{Ace or King}) = P(\text{Ace}) + P(\text{King}) = \frac{4}{52} + \frac{4}{52} = \frac{8}{52} = \frac{2}{13}$

2. Overlapping (Non-Disjoint) Events & The General Addition Rule

When events $A$ and $B$ can occur simultaneously ($P(A \text{ and } B) > 0$), adding $P(A) + P(B)$ directly counts the shared intersection twice. To correct for this double-counting, the intersection must be subtracted once.

The General Addition Rule: $P(A \text{ or } B) = P(A) + P(B) - P(A \text{ and } B)$

• Example: Drawing a single card from a $52$-card deck. Event $A = \text{Heart}$ ($13$ cards), Event $B = \text{Face Card}$ ($12$ cards). The Ace is not a face card; face cards are Jack, Queen, King. There are $3$ Heart Face Cards (Jack, Queen, King of Hearts), which are in both sets. $P(\text{Heart or Face Card}) = P(\text{Heart}) + P(\text{Face Card}) - P(\text{Heart and Face Card})$ $P(\text{Heart or Face Card}) = \frac{13}{52} + \frac{12}{52} - \frac{3}{52} = \frac{22}{52} = \frac{11}{26} \approx 0.4231$

---

Step-by-Step Worked Examples

Worked Example 1: Marble Urn Sampling (With vs. Without Replacement)

An urn contains $6$ red marbles, $4$ blue marbles, and $2$ green marbles ($12$ marbles total). Two marbles are drawn sequentially.

Case A: With Replacement (Independent Events) Find the probability that the first marble is Red AND the second marble is Blue.

1. Probability of first marble Red: $P(R_1) = \frac{6}{12} = \frac{1}{2}$.
2. Marble is returned to urn; sample space resets to $12$ marbles ($6$ red, $4$ blue, $2$ green).
3. Probability of second marble Blue: $P(B_2) = \frac{4}{12} = \frac{1}{3}$.
4. Joint probability: $P(R_1 \text{ and } B_2) = P(R_1) \cdot P(B_2) = \frac{1}{2} \cdot \frac{1}{3} = \frac{1}{6} \approx 0.1667$

Case B: Without Replacement (Dependent Events) Find the probability that both selected marbles are Red.

1. Probability of first marble Red: $P(R_1) = \frac{6}{12} = \frac{1}{2}$.
2. Red marble is set aside; remaining contents: $11$ total marbles ($5$ red, $4$ blue, $2$ green).
3. Conditional probability of second marble Red: $P(R_2 \mid R_1) = \frac{5}{11}$.
4. Joint probability: $P(R_1 \text{ and } R_2) = P(R_1) \cdot P(R_2 \mid R_1) = \frac{6}{12} \cdot \frac{5}{11} = \frac{1}{2} \cdot \frac{5}{11} = \frac{5}{22} \approx 0.2273$

---

Worked Example 2: Rolling Two Dice (General Addition Rule)

Two standard fair six-sided dice are rolled simultaneously ($n(S) = 36$). What is the probability that the sum of the dice is a multiple of $3$ OR greater than or equal to $9$?

Step 1: Identify outcomes for Event $A$ (Sum is a multiple of $3$) Multiples of $3$ possible on two dice are sums of $3, 6, 9,$ and $12$:

• Sum $= 3$: $\{(1,2), (2,1)\} \implies 2\text{ outcomes}$
• Sum $= 6$: $\{(1,5), (2,4), (3,3), (4,2), (5,1)\} \implies 5\text{ outcomes}$
• Sum $= 9$: $\{(3,6), (4,5), (5,4), (6,3)\} \implies 4\text{ outcomes}$
• Sum $= 12$: $\{(6,6)\} \implies 1\text{ outcome}$
• Total favorable for $A$: $n(A) = 2 + 5 + 4 + 1 = 12 \implies P(A) = \frac{12}{36}$

Step 2: Identify outcomes for Event $B$ (Sum $\ge 9$) Sums $\ge 9$ are sums of $9, 10, 11,$ and $12$:

• Sum $= 9$: $\{(3,6), (4,5), (5,4), (6,3)\} \implies 4\text{ outcomes}$
• Sum $= 10$: $\{(4,6), (5,5), (6,4)\} \implies 3\text{ outcomes}$
• Sum $= 11$: $\{(5,6), (6,5)\} \implies 2\text{ outcomes}$
• Sum $= 12$: $\{(6,6)\} \implies 1\text{ outcome}$
• Total favorable for $B$: $n(B) = 4 + 3 + 2 + 1 = 10 \implies P(B) = \frac{10}{36}$

Step 3: Identify the overlapping intersection ($A \cap B$) Outcomes that are BOTH multiples of $3$ AND $\ge 9$ are sums of $9$ and $12$:

• Sum $= 9$: $4\text{ outcomes}$
• Sum $= 12$: $1\text{ outcome}$
• $n(A \cap B) = 4 + 1 = 5 \implies P(A \text{ and } B) = \frac{5}{36}$

Step 4: Apply the General Addition Rule $P(A \text{ or } B) = P(A) + P(B) - P(A \text{ and } B) = \frac{12}{36} + \frac{10}{36} - \frac{5}{36} = \frac{17}{36} \approx 0.4722$

---

Worked Example 3: Contingency Tables & Survey Conditional Probabilities

A survey of $200$ college students recorded their academic major and whether they participate in extracurricular athletics:

1. Find $P(\text{Athlete})$: Marginal probability = $\frac{80}{200} = \frac{2}{5} = 0.40$.
2. Find $P(\text{STEM and Athlete})$: Joint probability = $\frac{30}{200} = \frac{3}{20} = 0.15$.
3. Find $P(\text{Athlete} \mid \text{STEM})$: Conditional probability (restrict denominator to STEM row total $80$): $P(A \mid S) = \frac{n(A \cap S)}{n(S)} = \frac{30}{80} = \frac{3}{8} = 0.375$
4. Find $P(\text{Business or Athlete})$: Apply General Addition Rule: $P(B \text{ or } A) = P(B) + P(A) - P(B \cap A) = \frac{50}{200} + \frac{80}{200} - \frac{25}{200} = \frac{105}{200} = \frac{21}{40} = 0.525$

---

Common Pitfalls & ACCUPLACER Exam Traps

1. Forgetting to Subtract the Overlap in "OR" Problems: Direct addition of $P(A) + P(B)$ without checking for shared outcomes is the #1 probability error on the ACCUPLACER. Always ask: Can an outcome satisfy both conditions? If yes, subtract $P(A \cap B)$.
2. Failing to Update Counts in Sampling Without Replacement: When drawing without replacement, students often decrease the numerator but forget to decrease the total denominator (e.g., writing $\frac{4}{12} \times \frac{3}{12}$ instead of $\frac{4}{12} \times \frac{3}{11}$).
3. The Gambler's Fallacy: Assuming that past independent random events alter future probabilities (e.g., believing that after flipping $5$ tails in a row, a head is "due"). For independent events, $P(\text{Heads})$ remains exactly $0.5$ on every single flip.
4. Confusing Odds with Probability:
   • Probability is $\frac{\text{Favorable}}{\text{Total Outcomes}}$.
   • Odds in favor is the ratio $\frac{\text{Favorable}}{\text{Unfavorable}}$.
   • If the probability of an event is $\frac{1}{4}$, the odds in favor are $1 : 3$ (one win for every three losses), NOT $1 : 4$.