Probability

Essential formulas and concepts in probability

Probability (classical definition)

\(P(A) = \dfrac{\text{number of favorable outcomes}}{\text{number of possible outcomes}}\)

Variables:

  • \(A is an event in a finite sample space with equally likely outcomes.\)

Description/Usage:

Gives the probability of event \(A\) by ratio if all outcomes are equally likely. For example, the probability of rolling a 5 on a fair six-sided die is \(1/6\).

Mathematical concept visualization

Complement Rule

\(P(A^c) = 1 - P(A)\)

Variables:

Description/Usage:

The probability that \(A\)

Mathematical concept visualization

Addition Rule (Union of Events)

\(P(A \cup B) = P(A) + P(B) - P(A \cap B)\)

Variables:

Description/Usage:

Mathematical concept visualization

Conditional Probability

\(P(A \mid B) = \dfrac{P(A \cap B)}{P(B)}\)

Variables:

Description/Usage:

Updates the probability of \(A\) under the condition that \(B\) is known to have happened. For example, the probability it’s raining given that the sky is cloudy. Visually explained using a restricted sample space (just \(B\) outcomes).

Mathematical concept visualization

Bayes’ Theorem

\(P(A \mid B) = \dfrac{P(B \mid A)\,P(A)}{P(B)}\)

Variables:

Description/Usage:

Allows inversion of conditional probabilities. It’s fundamental in statistical inference, relating the probability of a cause \(A\) given effect \(B\) to the probability of effect given cause. Often visualized with probability trees or Bayes’ boxes.

Mathematical concept visualization

Binomial Distribution (Probability of $k$ successes)

\(P(X = k) = \binom{n}{k} p^k (1-p)^{n-k}\)

Variables:

Description/Usage:

Gives the probability of exactly \(k\) successes in \(n\) Bernoulli trials. For example, the chance of getting exactly 3 heads in 5 fair coin flips. The distribution’s probabilities can be visualized with a histogram or Pascal’s triangle (for small \(n\)).

Mathematical concept visualization

Expected Value (Mean) of a Discrete Random Variable

\(E[X] = \sum_{i} x_i\, P(X = x_i)\)

Variables:

  • \(X is a random variable that takes values x_i with probability P(X=x_i).\)

Description/Usage:

Mathematical concept visualization