Probability Distributions
Key Takeaways
- The normal (Gaussian) distribution is the most important distribution — described by mean μ and standard deviation σ.
- The empirical rule: 68% of data falls within ±1σ, 95% within ±2σ, 99.7% within ±3σ of the mean.
- The binomial distribution models the number of successes in n independent trials with probability p.
- The Poisson distribution models rare events occurring at a constant average rate λ.
- Standard normal z-scores convert any normal distribution to the standard form: z = (x - μ)/σ.
- The exponential distribution models time between events in a Poisson process.
Probability Distributions
Discrete Distributions
Binomial Distribution
Models the number of successes in n independent trials, each with probability p of success.
| Parameter | Formula |
|---|---|
| Mean | μ = np |
| Variance | σ² = np(1-p) |
| Standard Deviation | σ = √(np(1-p)) |
Example: A quality inspector tests 10 items, each with a 5% defect rate. What is the probability of finding exactly 2 defectives?
P(X = 2) = C(10,2)(0.05)²(0.95)⁸ = 45 × 0.0025 × 0.6634 = 0.0746 ≈ 7.5%
Poisson Distribution
Models the number of events in a fixed interval when events occur at constant average rate λ.
| Parameter | Formula |
|---|---|
| Mean | μ = λ |
| Variance | σ² = λ |
Example: A call center receives an average of 3 calls per minute. What is the probability of exactly 5 calls in a given minute?
P(X = 5) = e⁻³ · 3⁵ / 5! = 0.0498 · 243 / 120 = 0.1008 ≈ 10.1%
Continuous Distributions
Normal (Gaussian) Distribution
Key Properties:
- Bell-shaped and symmetric about the mean μ
- Mean = median = mode
- Total area under the curve = 1
- Characterized entirely by μ (location) and σ (spread)
Standard Normal Distribution (z-distribution):
The z-score tells you how many standard deviations x is from the mean.
Empirical Rule (68-95-99.7)
| Range | Probability |
|---|---|
| μ ± 1σ | 68.27% |
| μ ± 2σ | 95.45% |
| μ ± 3σ | 99.73% |
Example: Bolt diameters are normally distributed with μ = 10.0 mm and σ = 0.1 mm. What percentage falls between 9.8 mm and 10.2 mm?
9.8 mm = μ - 2σ, 10.2 mm = μ + 2σ → 95.45% fall in this range.
Uniform Distribution
All values in [a, b] are equally likely.
| Parameter | Formula |
|---|---|
| f(x) = 1/(b-a) for a ≤ x ≤ b | |
| Mean | μ = (a+b)/2 |
| Variance | σ² = (b-a)²/12 |
Exponential Distribution
Models the time between events in a Poisson process with rate λ.
| Parameter | Formula |
|---|---|
| Mean | μ = 1/λ |
| Variance | σ² = 1/λ² |
| CDF | P(X ≤ x) = 1 - e⁻λˣ |
Memoryless property: P(X > s + t | X > s) = P(X > t). The probability of an event occurring in the next t units does not depend on how long you have already waited.
A process has a defect rate of 10%. In a batch of 20 items, what is the expected number of defective items?
For a normal distribution with μ = 50 and σ = 5, what is the z-score for x = 62.5?
Server failures follow a Poisson distribution with an average of 2 failures per month. What is the probability of zero failures in a given month?