Probability Distributions

Key Takeaways

  • The normal (Gaussian) distribution is the most important distribution — described by mean μ and standard deviation σ.
  • The empirical rule: 68% of data falls within ±1σ, 95% within ±2σ, 99.7% within ±3σ of the mean.
  • The binomial distribution models the number of successes in n independent trials with probability p.
  • The Poisson distribution models rare events occurring at a constant average rate λ.
  • Standard normal z-scores convert any normal distribution to the standard form: z = (x - μ)/σ.
  • The exponential distribution models time between events in a Poisson process.
Last updated: March 2026

Probability Distributions

Discrete Distributions

Binomial Distribution

Models the number of successes in n independent trials, each with probability p of success.

P(X=k)=(nk)pk(1p)nkP(X = k) = \binom{n}{k} p^k (1-p)^{n-k}

ParameterFormula
Meanμ = np
Varianceσ² = np(1-p)
Standard Deviationσ = √(np(1-p))

Example: A quality inspector tests 10 items, each with a 5% defect rate. What is the probability of finding exactly 2 defectives?

P(X = 2) = C(10,2)(0.05)²(0.95)⁸ = 45 × 0.0025 × 0.6634 = 0.0746 ≈ 7.5%

Poisson Distribution

Models the number of events in a fixed interval when events occur at constant average rate λ.

P(X=k)=eλλkk!P(X = k) = \frac{e^{-\lambda} \lambda^k}{k!}

ParameterFormula
Meanμ = λ
Varianceσ² = λ

Example: A call center receives an average of 3 calls per minute. What is the probability of exactly 5 calls in a given minute?

P(X = 5) = e⁻³ · 3⁵ / 5! = 0.0498 · 243 / 120 = 0.1008 ≈ 10.1%

Continuous Distributions

Normal (Gaussian) Distribution

f(x)=1σ2πe(xμ)22σ2f(x) = \frac{1}{\sigma\sqrt{2\pi}} e^{-\frac{(x-\mu)^2}{2\sigma^2}}

Key Properties:

  • Bell-shaped and symmetric about the mean μ
  • Mean = median = mode
  • Total area under the curve = 1
  • Characterized entirely by μ (location) and σ (spread)

Standard Normal Distribution (z-distribution): z=xμσz = \frac{x - \mu}{\sigma}

The z-score tells you how many standard deviations x is from the mean.

Empirical Rule (68-95-99.7)

RangeProbability
μ ± 1σ68.27%
μ ± 2σ95.45%
μ ± 3σ99.73%

Example: Bolt diameters are normally distributed with μ = 10.0 mm and σ = 0.1 mm. What percentage falls between 9.8 mm and 10.2 mm?

9.8 mm = μ - 2σ, 10.2 mm = μ + 2σ → 95.45% fall in this range.

Uniform Distribution

All values in [a, b] are equally likely.

ParameterFormula
PDFf(x) = 1/(b-a) for a ≤ x ≤ b
Meanμ = (a+b)/2
Varianceσ² = (b-a)²/12

Exponential Distribution

Models the time between events in a Poisson process with rate λ.

f(x)=λeλxfor x0f(x) = \lambda e^{-\lambda x} \quad \text{for } x \geq 0

ParameterFormula
Meanμ = 1/λ
Varianceσ² = 1/λ²
CDFP(X ≤ x) = 1 - e⁻λˣ

Memoryless property: P(X > s + t | X > s) = P(X > t). The probability of an event occurring in the next t units does not depend on how long you have already waited.

Test Your Knowledge

A process has a defect rate of 10%. In a batch of 20 items, what is the expected number of defective items?

A
B
C
D
Test Your Knowledge

For a normal distribution with μ = 50 and σ = 5, what is the z-score for x = 62.5?

A
B
C
D
Test Your Knowledge

Server failures follow a Poisson distribution with an average of 2 failures per month. What is the probability of zero failures in a given month?

A
B
C
D